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ABSTRACT 
This research examined the development, 


edg@awistration and analysis of the resuits of a survey 
to measure the satisfacticn of users with the contract 
administration services provided by both the Defense 
Contract Administration Services (DCAS) and the Plant 
Cognizance activities. The survey was the third part 
of an Office of the Assistant Secretary of Defense 


Citstallatlons and Logistics) “study Ssrrore. 


Analysis cr the eWdacae TObtealived - yielded!) a2cur 
conciluciens: (a) the Sample obtained was 
representative of the Department of Defense 
procurement workforce; (b) the responses to the 


overall evaluative questions were accurate reflecticns 
of responses to the individual functional questions; 
(c) the demcgraphic characteristics of the respondents 
did net bias the evaluative responses and (d) of the 
£OUe Wihajor ateasS of contract administration, cnly 
pngineering was statistically different fer both DCAS 


and Plant Ccgnizance activities. 


Some recommendations for eEurther research and 


study are also provided. 
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The Armed Services Procurement Regulations (ASPR 
201. 4) define contracts EO. Sse an: adds Stypes “on 
agreements and orders for the procurement cf supplies or 
services." ACCOEGInG LO “WeEDSter, a -rcentract “TS Nan 
agreement, especially one legaliy enforceable, between two 
Sree MOre persons tc do or £O0rbeéar Something..." ft is a 
bilateral agreement and when written, sets forth the frignts 
and Obligations of. the parties involved. It contains a 
mibtatude of promises agreed to by both parties invel+v¥ing 
the preducts or services to be delivered under the contract, 
the pericd of performance or delivery dates for the preducts 
Sereservices, the price to be paid fer the producte or 
services, the penalties for failure of either party to abide 


by itS ptcmises and other related conditions. 


In the commercial marketplace, a certain degree of 
h 


flexibility and business freedom are practiced in the 


everyday course of business transactions. HOWEVER, =Esas 
mlexibirility and treedon are Nor desirable in thre 
GovernmentyDefense industry marketplace where the 


transacticns involve the expenditure of sizeable amounts of 
Pielic funds. Contract administration, as the Commission on 
Government Procurement states, "...involves tne actions 
necessary to insure compliance with the terms and conditions 
OL the SOMEEAC ts! Contract administration for the 
Departnent of Detense has evolved to insure that the 
contractual rights of the Government /fand, in turn, the 


Buclic) are protected. 





Government procurement is big puSiness. In fiscal year 
1972, it invclved almost 16 million separate transactions 
and $57 rEillion. The Department of Defense was responsible 
Mer aq Mager fOrtioOn Or these transactions. 02. cae, abn 
fiscal year 1972, bOD'sS purchases from industry in America 
exceeded $38 billion with over 10 miilion transactions. In 
1968, at the height of the Vietnam conflict, employment in 
defense-related industries was approximately 3.5 million 
people. WHE. “the Sao> Mellon military ersonnel on active 
duty and the 1.3 million people employed in the Denartment 
of Defense as civil service personnel, a total cf 8.3 
Million feople were involved in defense-related business. 


This represented about 10% of the nation's work force. 


The responsibility of managing and administering tke big 
business of Defens@ procurement initially rests with the 
precuring agency. Hic ftobs, Ong anil zane i on, decisions 
affecting individual procurements are accomplished ty the 
Pececuring Ccntracting “Officer With - advice and ‘guidance 
Broyvyided by the program manager and the technical staffs. 
The Armed Services Procurement Regulations (ASPR) 1-40E (see 
Appendix A) provides for the delegation of certain contract 
administraticn responsibilities. For the Department of 
Defense, two major contract administration organizaticns are 
available. These are the Defense Contract Administration 
Services (DCAS) managed py the Defense Supply Agency (DSA), 
and the individual service organizations which include the 
Army Plant Activities, Navy Plant Representative Offices 
(NAVPROS) and Airc Force Plant Representative Offices 
(ir PROS. ) fine: GGAS “oOrgemizerton frunctacns Driagaril 7 Jone 
geographic basis with a region/district netheod of operation. 
It does have a number of individual defense industry piant 
assignments which is the primary method of creration fcr the 
Serpiece contract adminiStration activities, “In March 1972, 
DCAS compecnentsS were assigned to 34% DOD industry elants 


While the services had responsibility for 39 (Army: 5; Navy: 





eee Ait force: 19.) Even though the autherity of these 
Varemous Contract administration activities is derived from 
the same source, namely ASPR, individual Poe yy and 
precedural difrerences have arisen from parent organization 


interpretatica and implementation of the ASPR provisions. 


im Gatiying cut their responsibilities, the contract 
administraticn components can do much to assist in the 
effective and efficient meeting of the derense industry's 
and Government's contractual obligations. On “ihe “oraer 
moemGe che contract administration component can burden botk 
the Government buying office and defense ccntractor with 
unnecessary restrictions and unproductive requirements. A 
sound. precurement, from the standpoint of valid requirements 
determinations, Beatast lc svecifications and delivery 
reguirements, raticnal source selection and reasonable terms 
and conditions, can be easily turned into a contractual and 
financial Nightmare by the mis-applicaticn of contract 


administraticn procedures and requirements. 


SOmtrbact agdminiStration 1S an integral part of tae 
defense proctrement system, a part whose impcrtance is ofte 


Nn 
= 


) 


undéer-stated. Its importance and place in defen 


procurement must be understood and appreciated. 


eZ sulysi975, the Office of the Assistant Secretary 
of Defense (OASD), (Installations and Logistics) announced a 
meme seudy Of the contract administration ftnction in the 
Department ocr Defense. The study was to encompass not only 
the Defense Contract Administration Services (DCAS), but 
alee Prelude the Army, Navy and Air Force contract 
administraticn ofganizations. The major purpose of the 
Study was tc develop improved policies which would cptimize 
Manpower resources to accomplish essential contract 
administraticn tasks. Overall direction of the erfort was 


assigned to an OASD Study Coordinator with tie authority ele. 





meow, rescurces and data Tron the three services and the 


Defense Surrly Agency. 


The acccmplishment of this study was to require three 
phases. The first phase involved the formation of joint 
Army, Navy, Aix Force and DCAS functional teams. These 


teams were composed of individuals, botn military an 


Do NM 


Civilian, with expertise in the various aspects of de¢fens 
prcecurement, such as cost analysis, engineering, 
Samanistraticn, quality assurance, etc. The teans visited 
aperopriate component Headquarters Commands to ascertain and 
review the existence of policy and gwidance at the 
headguarters' level. The teams then separated into East and 
west ccast groups and went into selected contract 
administration activities to evaluate the implementaticn of 
the headguarters' folicies at the working level. At tae 
Same time, the attitudes of working level personnel vere 
sampled along with any suggestions for improvements or 
policy deletion. Innovative approaches to Com prace 


administraticn problems were also sought. 


The second phase of the study involved a resource 
Merlizaticn audit to be accomplished DY” ~“=hie= 2025) 
(ecemprroller.) Toes. :spoase. vexamined Cte Utila icon Or 
Manpower and resources to determine whether the optigun 
amcunt ctr resources were being ‘applied to accompplish 


@Saeencial cCOntract administration tasks, 


Phase three of tne study involved the development of a 
guéstionnaire to be administered at selected DOD tuying 
activities tc survey the attitudes and opinions cf tneir 
personnel toward the services provided to them Ey the 
SOntEact administration components (DeXS, ATHY Piant 
Activity, Naval Flant Pepresentative Office (NAVPRO), and 
Air Force Plant Representative Office (AFPRO).) The purrose 


cir the questionnaire was "...to determine overall DOD tuying 





miemCes’ SaAtiSTaction Wltnh the Services cbtained in “the 


uSser-custcmer relationship." 


BietrreCe cwing Chart Ocutiines the organization -of “the 


Severali CASL study effort. 


OASD Study 


SOOrdI nator 


Funct lonal Resource Users! 
Teams Avds & Satisfaction 
(OASD (C) ) Questionnaire 








The purpcese of this paper is to examine, in detail, this 
maard phase of the OASD study on contract administration, 
the buying office/reguiring activity satisfaction With 
contract administration services. Subseguent chaodters will 
detalii the rationale and methodology of the study, the 
SiaractelListics of the Dparticirants of the study, tne 
SemEectiacich cr the Study participants to the DOD procurensntr 
workforce, and a general analysis of the survey results. 
Finaliy, scme reccmmendations for further studies based upon 


the survey resuits will be presented. 
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A. Reasons for Selecting Questionnaire Methcd 


There were two basic approaches for accomplishing t 
miepose Of tke thitd part of the OASD study. ihe “plroe 
approach would have involved tne selection or a few Major 
DOD buying activities and then the erformance or an 
extensive interview of those activities! attitudes toward 
contract administration services (CAS.) The second approach 
was the develcpment of an inclusive, Eut generalized 
questionnaire that could be administered at a greater number 


@e activities. 


The first apprcach would have permitted an in-de 
analysis of the individuals within those activities 

their attitudes with rollow-ud interviews on specific items 
and areas uncovered during «he initial questioning and 
Sampling. Hcwever, it was decided that such an apcrroach 
Pod permit the introduction of a Sampling bias in favor of 
the few very large buying activities. It may have unccvered 
Significant ecroblem areas, but would have given undue 
attention to areas cnaracteristic of the few large tuying 
Organizaticns which were chosen. Generalization cf any 
findings to cverail DOD buying activities would have teen 


extremely difficult. 


The seccnd approach, that of a questionnaire to sazsble a 
darger number of activities and individuals within these 
activities, was chosen. (ote we this avprOdeis Would not 


permit, in the time available, detailed examination cf any 


14 





Sronificant problem areas uncovered, it would provide for a 
breader response band or general attitudes and opinions that 
Sseuld mcre rationally be applied to all DOD bu ying 
components. It was furtner feit that such an approach wouid 
highlight fundamental, recurring type problems that could be 
GMmaraecerized aS DOD-wide Of ServVice-intensive. ‘“Sucn an 
Seefroach, USing ancnymous questionnaires, aight also provide 
a vehicle fcr receiving suggestions from the respondents as 


to imprcevements in the contract administration system. 


ifipeers Srecognized that Jthe questionnaire form cf data 
Ses leccicnh haS limitations. In attitude surveys, it is very 
difficult tc determine the frame of reference ofr the 
respondent. His responses to the questions can be derived 
frcem erreneovs experience sets. Individual interpretation 
OL guesticns and vording can vary greatly. GEadgatlcn. o< 
responses are dit ireule to measure. However, the 
questionnaire method 1s guick, relatively inexpensive and 
usually produces a bountiful amount of data. The impact of 
individual differences would be minimized cy aggregation. 
This seccend approach would also provide a significant data 
base for future research in this area of study, and fernit 
Concentration and in-depth analysis of specific prceblems 
areas. Fcr these reasons, the questionnaire aethod was 


selected. 


B. Design cf the Questionnaire 


The guestionnaire was designed to ootain three tyces of 
mmcOrmaticn and data. In PART 1, personal informaticn acout 


the respcndent and his background and experience with 


A 
3 


@emtract adtlinistration Services was SC 1icieeda. 


in 


4 


ant 


@ 
ctr 


informaticn weuld be useful] in classifying the respend 


Q 


ema in the adentitication of any Significant trends anon 
i 


the varicus categories of respondents, grouped either b 


~< 


lz 





Seomee, age, schnocling, sroduct line, €tc. PART Z 


solicited the respondents! evaluation cf the varictus 
Gomtract  adninistration rcrunctionas perforzed DY fve bd 
Contract qehe meat ha clon, oser vices. =(GAS), WCtEVi ties. re 


Specifically requested their evaluations of the Defense 
G@entract Administration Services performance, of the service 
contract administration activities performance, and finaily 
@ekea WhetEer that particular function could Eetter be 
Petrormed by the buying/reguiring office. The third type of 
informaticn desired was suggestions and ccmments frem the 
respondents. Space was vorovided on each page of PART Z2 for 
els, abd cne paragrapn of the PART 2 instruction sheet 
imiveteqg the participant to provide this type of information. 
Appendix B contains a sample of the entire guesticnnaire 


package. 


PART 2 of the questionnaire was develored using the ASDPR 


1-406 (Appendix A) ISemng ser VeEOnt Tract -agtintet ra evo 
functions as a kase-line. The functions vere, in some 
cases, combined, redescribed Or ene ted. ett Vee Ute 


Paretions were finally identified and sub-divided inte four 
major functicnal areas: General Contract Administration, 
Peoaqucticn, Guality Assurance and Engineering. In additiocn, 
Sl1x general cuesticns were added to each of the four maior 
categories. These questions concerned tne (1) providing of 
advice tc the buying office, (2) responsiveness or the CAS 
eemponent (3) working relationship or the CAS component with 
Eme Ccntractcr(s), (4) manning of tne CAS component, (5) 
technical expertise of the CAS component and (6) géneral 


O@yectall perfcrmance of the CAS component. 


The questionnaire was designed to reguire approximately 


30 minutes tc canpletely answer all the questions on each 


Hy" 


page. It was expected that only certain respondents wit 
extensive experience in contract administration weculd be 


oro uO Vancwer Paliigqguestions. Space for “No Comment” wes 


tie 





previded for all evaluative questions. In addition, a block 
Was provided at the top of each page of the evaluative 
portion which enarled a respondent to indicate that he aid 
not have sufficient experience in that particular category 
to answer any of the questions . In this manner, after 
guickly reviewing the category of functions, the respondent 
@omurd by checking this one biock complete the page. Tn 
caseS where this was done, the averacse time for completion 
of the questionnaire was reduced to between apprcximately 


Fifteen and twenty minutes. 


Horecko cVyvalllationror° €he “DCAS- “dnd service “contract 
administraticn activities in PART 2, one other design 
feature shculd be mentioned. The number of response 
categories available to each respondent was four (the "No 
Comment" cclumn has “previously peen discussed.) Duo > VOL 
these resporse categories could be considered as favcrable 
meeronses ("Exceilent,” "“Satistactory™"), and two cculid be 
considered unfavorable (UNeeds Improvemercrt,'" 
"Unsatisfactcry"), The use of four categories was thougnt 
desirable since it would force the respondent to indicate a 
faverable or unfavorable attitiude. A middle-of-the-read or 


average respcnse was thereoy discouraged. 


The £ermzating of tne the questionnaire was as follcws: 


1. Ccvering Memorandum under the letter-head of the 


Office cf the ASsistant Secretary of Defense. 


Zoe ine) | — VNemographie Datay Sheet. 


oe Mest mucti Onno neces “~Or PART. 2. 


4. PART 2 - Function Evaluation Sheets (4). 








ro ee 


C. Preparaticn and Pretest of the Questionnaire 


The development of the questionnaire commenced in 
Beprember, 197/75. Hn pene: Wext “EWor-e@nd “4 bail= Gheaeas, 
humerous revisions to tne format and questions were made. 
[Mieke tecm the OASD Study Coordinator, aiong with tse 
Ofinicns and suggestions of the functional team semkers were 
sclicited. Many cf their cecommendations were included in 
the pretest versicn of the guestionnaire. Since the 
guestionnaire would ultimately pe aistributed to alli the 
services, a2 tri-~seéervice pretest sampie was chosen. The 


following activities were used to pretest the questicnnaire: 


ARMY - Sacramento Army Depot, Sacramento, Ca 
NAVY - Naval Weapons Center, China Lake, CA 


AF - Space and-Missile Systems Office, Les Angeles, CA 


Mees pretesc tcok place at these activities in late Ncvenper 
w75. 


Twenty questionnaires were administered at each of the 
above Benticned ACtTiIVit Les. PIety Percent or tke 
questionnaires were distributed to procurement perscnnel. 
These fperscrnel were categorized as procuring contracting 
MurtecrsS (FCO's), EUYeES, negotiators, cost analysts and 
Gontract Specialists. The palance or the questionnfieres 
went tc ncn-procurenent perscnnel. These were the 
engineers, technicians, logisticians, guality assurance and 
Pecaouctilcn specialists. While, in most large Ewy 13g 
activities, there 1s a great disparity in the numbers of 
people assigned tc procurement functions (as catégcrized 
akcve) Versus anacn-procurement functions, it was feit that 


the even split in the distribution of the guestionnaire was 


” 


justified since the procurement personnel interfaced more 
intimately and nore frequentiy with the GOutract 
adginistraticn ccmponents. The even distribution system was 


v2 





Oleeimately fcllowed an the administretion ot the final 


questicnnalire. 


Since the guestionnaire was to be self-explanatcry, at 
each of tke pretest activities the questionnaire was 
@@etriouted without verbal instructions to the partici fants. 
BEcet am arreropriate ainterval (one to two hours), each 
participant was asked to return the questionnaire to one of 
the pretest team members. At this time, the resfondent's 
reactions tc and comments about the questionnaire were 
solicited. SpeCiTLC guestions were provided to each 
intervierer tc insure coverage of ail the applicable 
features cf the questionnaire. Those guesticns included the 
guesticnnaire format, eng ti, UDG@ersStardirp wii | and 
wording/guestion ambiguities. OtHer comments and 


suggestions for lmprevement were also solicited. 


As a result of the pretesting and the ccmments received, 
Various chances were madé and the questionnaire package was 


mevieecd intc its final forn. (Appendix B) 


Pppeeccempilaticn ct Distribution Lists 


iieetee “firs phase of the OASD study mentioned in 
Chapter I, functional teams visited Various COltracse 
Seiaistraticn field activities, (DCAS, Army, Navy and Aire 
Force.) Subsequent to these visits, these field activities 
were reguested tc provide the OASD teams with lists cf the 
ten buying offices who were their major users in terms of 
Number of contracts and dollar value. Upon receipt cf these 
lists, an array of the user activities bdby service was 
Genstructed, Each time an activity was listed by one cr the 
Sontract adMlniStratlon organizations, it was resorded on a 
irsting. It was then determined subjectively that five or 
Six user activities for each service would be utilized. fhe 


| 


MC OMm mer sist. sactavyrteLes | Most “often ii Sted for-eackh cz the 


16 











ea ee 


Services were then selected. Mieco newocase “Ot. “0S A) “che 
activities mrcost often listed were selected. With these 
parameters, a Sample size of between elgnteen and twenty-one 
Metivicic= i (fcr tne three services and--DSA) would oe 
available. This numpoer of activities would be withir the 
financial and time constraints in existence, woulc bea 
Manageable sample and saould provide a good cross-section of 
the buying cffices' attitudes in the Department of Defense. 
This sample also avoided the danger of concentration of the 
study in ocrly one or two large activities and a sample of 


attitudes based on circumstances unique to then. 


Geel anring the Guest Vonnalrs @LLOrt, 1t Was Oflginaliy 
envisioned that employee lists would be obtained from tne 
selected activities. Selection of employees (using an even 
division Eetween oroéurement and ncn-procurement perscennel) 


would ke acccmplished by use of a randcm number tarle. The 


questionnaires would then be mailed to tne selected 
midivaiduals directiy, and subsejuently returned to the Naval 


Hesegbtaduate School for erocessing. Historically, a  terurn 
rate of between 25% and 35% of mailed questionnaires is 
generally experienced. Based on the fact that the covering 
Hot“emaiauh ftom GCASD would nignlight the importance cz the 
Sive@rt,; a Leturnh cate OF aporoximately 50% was anticipated 
ares be reésonabdle. Therefore, ao uPEl Nt inG or = dee 
gGuestionnaire packages was reguested. The printing cf 1,990 
Was felt te provide a sufficient number so that the sample 
wculd be significiant, yet be manageable. with a 50% return 
rate, a sauple cf 500 responses would be availabie for 


analysis. 


A peceblémp arcse, however, in the plan to mail the 
Guestionnaires. Circumstances evolved which precluded the 
Mailing cf the questionnaires and an alternate approach was 
developed. In this approach, the user activities to be 


Sampled were Givided into three groups. Each member cr tae 


ey 





guestionnaire development team would take one group of 
aetivities, and in the space of a twO week period, 
administer the guesticnnaire at each of his activities. He 
Memrde also collect them from the participants prior to has 
departure frem the activity. Three main benerits from this 
approach were envisioned. First, the time requirenent woulda 
be considerakly shortened. Tne questionnaires would be 
distributed, returned and be available for trcecessing within 
a two week period. Secondly, the return rate would be 
consideratly greater than the 504 originally estimated. The 
Beird benefit would come fron the abril. orf the 
guestionnaire administrator to interface cirectly wito the 
command beincg sampled and avoid the possible distributicn of 
questionnaires to Eiased and/or otherwise ncn-responsive (by 
Virtue of their jot) personnel. It would also enable the 
administrator to handle unexpected circumstances such as 
alternate selection of respondents in the aksences of the 


selected respondents. 


Weethosthe ~ranting- “of 71,000 ‘questionnaires, it wes 
decided that 274 would be allocated to each service and an 
allocation of 130 questionnaires would be nade tc the 
Defense Suprly Agency (DSA) buying activities. No DSA 
activity actually received sufficient mention in the 
Miecings Of USer activities to quality for inclusion in the 
Ccriginal selection. However, it was decided that the 
questionnaire would not accurately sample DOD-wide -Euying 


activities unless they were included. 


The 2z74 guesticnnaires for each service were allccated 
to each activity based on the provortion of times they 
meecaced ¢n the contract administration activities’ users 


listings. The DSA questionnaires were allocated to three 


DSA activities ty roughly equating them with a Navy 
Mryentory eCcntrol  Point.° (ICP. The Defense Personnel 
SUE COLE Center OD Poe} Philadelphia was allccated a 
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proporticnately greater amount than the other twe ODSa 
activities. EPPSC handles three very different comnodities - 
eiotningstextiles, medical and provisions. Provisions are 
So unmigue that they were deleted from the questionnaire 
Srrcort. Egual ailocations were tnen provided for the 


Grething/textile, and the medical categories. 


Table 1 provides a summary of the activities sampled oby 
service, including the percentage or time they appeared on 
the user listings received, and tne number of guestionnaires 
eeocated ~tc Each activity. (Some minor errors are in tne 
table due to rounding and an attempt te allocate the 


@UeStionnalres to each activity in even numbers.) 


TABLS 1 


Distribution of Questionnaires 


service Activity iisfing questisangires 

ARMY ASC St Louis. 41% Ee: 
RCO) a. onnol er 24% 66 

Redstone Arsenal, AL 1576 42 

Missile Command, AL 12% 32 

ENDS COmmandad,, AL ___ 8% ee 

100% 274 

NAVY NAVAITE Wash DC 37% 102 
NAVSEA Wash DC 25% 68 

ASO Philadelpnia 13% 36 

SPCC Mechanicsburg 13% 36 

NAVELEX Wash DC __ 12% pepe toe 

100% 274 
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Dies F ASD Dayton uy % 120 


SA4SO Los Angeles 15% 42 
ALC Karner Robbins 12% a2 
ESD Hanscom, MA 12% 32 
MLC TS al santo LO. 1x 10% 26 
ALC Okiahoma City __/h eee 2 
100% 274 

DSA Cesc Fhiladelphia 69 
DESC Day eon 36 
BesC Colunbus eg a 
130 

Total Questionnaires 952 


~— 


E. Administering tne Questionnaire 


Tere guestionnaires were administered to the selected 
activities within a three week period in the amiddle of 


January 1976. 


meaemw USer- activity “to be visited “WwaS requested to 
prcevide the name of a contact point for the questionnaire 
administrator. By telephone, these individuals were priered 
on the furfpeses of the questionnaire and its bart in the 
Ooverail OASD study. The number of gquesticnnaires to be 
distributed at that activity and the method of distrikution 
were discussed. Each contact was reguested is have 
available if possible, employee (both military and civilian) 
meetings cf 

{a) all pecsonnel within the procurement fieid, and 


(Sia dla eersonnel ourside tne orocurcment fieid- 


Boehm GrcecupsS were to be familiar with one cr nore cf tne 


Functional areas cf the questionnaire (General Ccntract 
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ee 


Ad@winistraticn, Prodile ea.o it, Quality Assurance Or 
POg@ineering.) Tt was recognized that sucno a listing might 
preclude a comrletely random sSampie of questionnaire 
Participants. However, wWita the linited number Oleg 
guestionnaires available, it was feit that wore meaningful 
data would be obtained by structuring the sample to exclude 
merece individuals who Might not provide a useful infut to 
the study. The selection of participants would still be 
made g¢crom the iistings of gualified personnel utilizing a 


ccmplete randcem selection. 


With this advance contact made, the procedure follcwed 
at €ach activity was essentially the sane for the three 
gGuestionnaire administrators. In the morning of arrival at 
imenuSer activity, the administrator would usualiy explain 
Maer GuUeStICNnalre t0 the  point-of=contact individuel and 
others within the command whose subordinates would be 
invoived in the guestionnaire erfort. Next, the two Lists 
of emplcy¢ees were examinined and py the use orf a <xrandon 
number tarle, the appropriate sample was selec 
addg5i0n, a  numper on alternative Individuale were 
designated. The questionnaires, with envelopes number- 
Sodea £Or CCntzol purposes, were then distributed ¢t the 
selected i.rdividuals. Tn geographic areas with more than 
One user activity, the administrator would then establish a 
return-time later in the day, and proceed tc repeat the same 


BeeCedure at the next activity. 


One  EarLticicants received the gquesticnnairss at their 
desks and were reguested to have them ccnpleted s4ithin 
Weuglily the next fcur to five hours. This approach was feit 
to be preferarle to naving all the selected participants 
assemble in a ccnference room at a pre-arranged time and 
ccrplete the questicnnaire while assembled. Not only would 
it be extremely difficult to asseample all the individuals on 


“GOs TOLeavetice wes DUt 1c ~Was -fe10° that cercain “grows 


21 











Mecssutes (f€ EIM1SH ELirst, not to Eilnish iast, etc.) +#ould 


bias the respenses to the questions. Completion of th 


iD 


questionnaire in the individual's own work environnenc, 
Within an ample time period, was thought to provide a aore 


conducive atucsphere for meaningful response. 


At the previously estabiished time, the questionnaire 
administrator returned to Go Piece t the completed 
questionnaires. At this time, it was Of sg i nay 


contemplated that the administrator would be available for 


re 


bts 


cle 
= oe © 


p) 


interviews with any respondents desiring to ens 


Cig 26% 


'T 


ccmment cn the questionnaire. Unfortunately, tin 


tp) 


permit tnis interview procedure. 


Bi Returns received 


AS Was reported previously, 952 gquesticnnaires were 
distributed to 719 different Department cf Defense LEuying 
activities. Cf this amount, 25 were not returned and S$ were 
rejected due to incomplete or missing data. The percentage 
Cerecculrn Was 960.48, which is considerably higher than the 
historical fpercentage of returns on mailed questicnnaires. 


Maree. 2 SUMMALTIZeS tne returns. 


UO el) rs: aaa 


Returns Received 


OVeESticnnalres Distributed 932 
Questicnnaires Not Returned 25 
Questicnnaires Rejected a a8 
Questicnnaires Returned S1é 
Percentage of Return $6 4% 


fad 





G. Processing the Returns 
4 

Upon receipt of a completed questionnaire, the fiv 
de 
h 


O 


pages were first marked with the three digit numerical 


(D 


A . 


co 
£ECE the questionnaire Seivelope “to  agnsure tha. “=z 
with 


attitudeycpirion responses were correctly identified 
the democrafphic data sheet. The guesticnnaire was tnen 
edited fcr cbhvious mistakes and errors. Where a resvonse 
area had been left blank, the question was edited with a "No 


Ccmment"™ resrense. 


Upon ccmpletion of editing, the questionnaires were then 
precessed through an OPSCAN Model 17 Reader and an IBM card 
data deck was produced. Bach questionnaire package was 
coded into 5 data cards. The data deck was then verified to 
Goesure 1ts accuracy with the actual questicnnaire respenses. 
Once this was done, the data deck was read cnto a tape for 


ease of processing. 


Hae Statistical Package for the Social Sciencies  ={S255) 
c 


Was used fcr precessing the data. Tt 1S an inteaqrated 
system cf computer programs designed for the analysis of 
BOGla! ‘sclence data. These programs were available for 


Samet ein the WN. HR. Church Computer Facility at the Navai 
Pestgragquate School utzlizing an IBM 360/76/ computer. Cz 
the Many SPSS procedures available for analysis of data, 
Sliuple frequency distributions and crosstabulations with 
specific descriptive statistics were the fErimary pregrans 


used. 
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it er On aC ano eo OF SHE RESPONDENTS 


eS ce ee mee we =——— === = ee EE SS ae a 


This chapter Summarizes the ana 


aemegraphic  ferticn “of the gquestionrairs:. 


Maetes Go = 1 to C = & |. contains additional 


lysis 


performed 


the characteristics cr the questionnaire respondents. 


nye type CE ACCIVItY 


ee 


The types of activities sampled are shown in Table 3. 


TABG SE. 3 
Type Of Activity 
Category Responcgents Percentege 
Systems Cc#mand 386 42% 
Buying ACTIVIty 297 32% 
Meaquiring Act/Prod Office 10s 11% 
moventcry Centroi* Point aA EX 
Stock Feint-Depeot-Center 45 o% 
Other 14 Za 
918 10C% 
Respondents in Systems Commands and Buying Activities 
dctinated the sources ope respondents Wita alnost 
SyEce-Qudrters Of the sample ccming from tkat population. 
This distrikution was in line with the characteristics 


desired cf the sample. It was felt 
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while 


a 


on tne 


Appendix C with 


StatlLetics on 


greater 














Mercentage <i contractual actions are relatively icw dollar 
value, aprroximately 90% of the dollars are spent in the 
larger dcllaxr value procurements accomplished in these two 
types of activities. It was the intent of the questionnaire 
to measure the attitudes of personnel doing the larger 


procurements with the greater defense dollar impact. 


EaeeserVice ci the Activity 


It waS originally decided that an even distributicn of 
the gquesticnnaires among the three services would be 
attempted with an arbitrary figure or 130 questionnaires 
Hewag  Gistraruted to the DSA activities. The results of 
quésticnnaire distribution are shown in Tabie 4. 


TABLE 4 


Service Distribution 


Service Allocated Returned Percentage 
Army 274 Z2a0 Sens, 
Navy 274 254 G2 5a % 
BiE Force 274 PAG AS) 101.8% 
DSA 130 128 98.5% 

952 914 96.0% 


In the case of the Air Force, four questionnaires over tne 
allecated atcunt were returned. This was due tc the 
recovery af questionnaires that had been allocated and 
distributed as alternates in case of employee absentees at 
epe time cf administration. Four individuals returning tne 


questionnaire had tarked "Other" as the service of tha 


tt 
iw @) 
(J) ; 
ho OD 


met avity. With these responses included, 918 oo 


guestionnaires were returned for a rate of return of S6.4%. 
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C. Service cf the Respondents 


@z the 91@ farticipants, i248 ‘or 13.5%. were in the 
Military service and 794 or 86.5% were civil service 
personnel. Table 5 provides more detailed information. 


TABLE 5 


Service of the Respondents 


Cumulative 
Setvice Respondents Percentage Percentage 
Army 24 2 0 & 2.6% 
Navy 30 Bop oraer 
Air Force _70 20% 13.5% 
Civil Service 194 86.5% 100.0% 
918 100.0% 
D. Rank and GS Rating of the Respondents 
A little over 60% Gr the respondents tc the 


questionnaire were of the Major/Lieutenant Commander or 
GS-12 civil service grade cr lower. TMPOEtAN. Lor tas 
Statistic is the belief that the sample was composed 
primarily eve personnel at the working level of the 
Organizations visited. The individuals who evaluated the 
contract administration functions were felt to be those with 
hands-on experience and who possessed the necessary werking 
Kncwledge of the contract administration components. Table 
6 furnishes the detailed anaiysis of the rark and GS rating 


structure ot the samele. 
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Wy: Wop Pome 


Rank and GS Rating 


Categery Respondents Percentage 
O-2, GS 1C€ and telow 149 16% 
C-3,0~-4, ¢S 11-12 414 45% 
Oeogecs ls-14 303 33% 
C>6 78 Gs- bo 0 6% 
916 100% 
Two respondents indicated the category "Cther" in their 
responses. 


E. Age cf the Resfoadents 


= 


Apprcximately two-thirds of the respondents were under 
50 years of age. The greatest number of respondents were in 
the age grceup of 41 - 50 years which represented 33% cr the 
sample. The middle categories of age (31 - 60) acccunted 
for 84% cf the sample. In Table 7, a detailed analysis is 


provided. 
PAB ee, 


Age of the Respondents 





Age Category Respondents Percentage 
FUT SiO 108 12% 
Sea 40 204 22% 

41 =- 5C 306 alae 
31 ~ 60 264 29% 
Over 60 a 4a 

917 100% 


2 





One respondent did not mark this category CE the 


guesticnnaire. 


F. Superviser Status 


2516 respondents (28%) indicated that they were 
superviscrs, while 662 (72%) indicated that they were not. 
Of the participants indicating that they were supervisors, 
Table 8 prevides a breakdown of the number of employees 
supervised. Two respondents who indicated supervisor 
Status, did not indicate the number of employees supervised. 
There is a fairly even distribution among the categories of 


the number of people supervised. 


2% TABLE 8 


Number or Employees Supervised 


Number of Employees Respondents Percentage 
Pece 5 68 27% 
6 te 10 64 25% 
11 tc 20 72 28% 
Cver 20 5 C 20% 
254 100% 


G. Education Level 


61% cf the respondents stated that they were college 
graduates. Table 9 shows the education distributicn cf the 


questionnaire sample. 
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TABLE 9 


Education Level of Respondents 


Category Respondents Percentage 
High Schocl 125 13% 
Some Ccllege 235 26% 
College Graduate 237 26% 
Some Graduate Wcrk 180 20% 
Graduate Legree OSs, 15% 

976 100% 


Two individuals did not respcnd to this question. 


H. Experience Level of the Respondents 


ca 


The experience level of the respondents was measured in 


two ways. First, the experience level in the respondents'! 
present assignment was Solicited. secondly, the 
respondents! total procurement related experience was 
Sougnt. 


Approximately 50% of the respondents had 5 years or more 
experience in their present asSignment and less tnan 10% nad 
keen in their current job for less than one year. AS far as 
the total precurement related experience is concerned, 76% 
had over 5 years or more of experience and less than 5% nad 
under one year cf procurement related experience. Tables 
C - 7 and C - 2 in Appendix cC provide the detailed 


statistical analysis of the experience category. 


i «Product Specialty 


Nine preduct categories were available for respcndent 


Zo 








consideratior. In eda@utien, —san "Other" .catedory \was 
provided in crder to provide a response band for all 
guestionnaire participants. 46% of the respondents were 
involved in the aircraft and missile product areas, while 
the electronics area captured almost 25% of the sample. The 
remaining preduct categories represented frem 7% (Services) 
to less than 1% (Electrical) of the sample. A detailed 
breakdcwn is provided in Table C - 3 of Appendix Cc. 


J. Types cf Frocurement 
82.4% of the respondents indicated that the negotiated 
procurement was most frequently encountered. This 


represented 756 of the 918 respondents. Table 10 provides 
the data. 7 


os 


TABLE 10 


Type Procurement Most Enccuntered 


Category Respondents Percentage 
Negotiated gisie 82.4% 
Formally Advertised 1g2 17.64 

918 100.0% 


The respcndents were asked to indicate the contract type 
most often encountered, Fixed price type contracts were 
most often encountered by 6 9% On tne respondents, 
cost-reimkursement contracts py 29% and other instruments 
such as Easic Crdering Agreements by 2%. Table 11 and Table 
C-4 ain Appendix C provide a more extensive breakdown cf the 


responses, 
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Category 
Fixed EFrice 


Gost Relmcurcsement 


Other 


FABLE V1 


Type Contract Most Encountered 


R 


The numker of contracts 


average 


value 


Table 12 outlines 


sample. 


Caregory 


Under 5 
Se 10 

11 - 20 
Zia 50 
Qver 50 


Numker and 
Number 


Respond 


Z2i 
118 
113 
127 


333 


SG 


per 


two 


Average 


espondents 


633 
262 

23 
918 


encountered ina 
contract are 


Characteristics 


TABLE 12 


year and the 


closely related. 


LAL tae =5 cudy 


Dollar Value of Contracts 


Percent Category 
25% Over $5M 
Waa oh) =a 
12% Seoee VS 
14% a a 
36% Under $.1M 

190% 


Respond Percent 
244 26% 
29 14% 

87 10% 
156 17% 

BS 33% 

918 100% 


hme CONtcact Administration Component Utilization 


Table 


respondents? 


provides 


Uert lization 


a general 
of the 
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Various 


breakdown of che 


CoOnrtrace 





administraticn agencies. The figures represent tne number 
of respondents utilizing the Gentract administration 
services previded by the indicated agency. [In the table, 
Many respondents indicated that they utilized more than one 
CAS organization. The percentage figure is the numter of 
individuals indicating they used the corresponding CAS 
organizaticn in relation to the total respondents to the 


questionnaire. (918) 
TABS lo 


Geir Zatvon Of GAs Services 


ComEecnent Respondents Fercentage 
DCAS 821 89% 
Army ae 240 26% 
Navy 437 48% 
Aix Force 496 54% 
Euying Office 564 61% 
Cther 79 9% 
Of the resrondents using DCAS SOE E0Ntrace 


administraticn services, Table 14 furnishes an analysis on 


the percezntace of utilization. 
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TABLE 14 


Utilization of DCAS 


Category Respondents Percentage 

O - 25% 208 25% 

26 - 50% 108 13% 

51 - 75% 113 14% 

76 - 100% 307 38% 

Unkncwn 85 10% 
821 100% 


Lesser numbers of respondents indicated that they used 
individual service “plant offices. For the individuals 
indicating utilization of the service Contract 
administraticn activities, Table 15 provides the analysis 
for the Army Plant Activities, Table 16 for the NAVPROs and 
Takie 17 for the A¥PROs. 


TABLE 15 


Utilization of Army Plant Activities 


Category Respondents Percentage 

O - 25% 128 53% 

26 - 508 23 10% 

51 - 75% 20 8% 

76 - 100% 27 

Unkncwn 42 18% 
240 100% 
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Category 
ORS 25% 
Zoe - 50% 
51 - 75% 
76 - 10C% 
Unknocwn 
Category 
P= 25% 
25. —> 50% 
al = 15% 
76 - 10CR 
Unkncwn 


TABLE 16 


Utilization of the NAVPROS 


Respondents 
270 
49 
19 
28 
71 


437 


cae Piste 17 


Utilization of the AFPRO 


Respondents 
297 
62 
20 
53 
64 


496 


34 


16% 
160% 


S 


Percentage 


60% 
12% 
U% 
11% 
13% 
100% 





This .chapter describes the four areas of analysis 
performed on the responses to the questionnaires. Part 1 
ccufares selected characteristics of the questionnaire 
Cespondents to those same characteristics in the DOD 
procurement workforce. Part 2 examines the relaticnship 
between the cverall rating given to each of the four general 
categories as indicated by responses to the guestion, 
"Overall, I would rate the performance of the aire 
ccmronent as:", and the responses of the participants to the 
individual functions within those general categories. Part 
3 discusses the influence OF certain demographic 
Characteristics on the responses to the overall ratings for 
each of the four general categories. Finally, Fart 4 
compares the overail ratings given to DCAS and the Plant 
Ccgnizance activities in each of the functional areas to 
determine if there exists a Significant difference in the 
ratings. Cenclusions based upon this analysis are given in 
Chapter V¥. In addition, two appendices ccntain detailed 
frequency distributions. Appendix G refiects the total 
results cf the survey for the demographic characteristics of 
the respcendents and their answers to the questions in each 
category. The absclute frequencies and their relative 
frequency percentages are given for each response. Those 
cases in which the respondent did not answer a questicn or 
indicated "No Ccmment" were identified as missing values. 
As such, they are not included in the adjusted frequency 
percentages. Appendix H contains the total results obtained 


for each cf the categories arter adjusting the resSfonses 
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into a tavcrableyunfavorable categorization as noted in 


Giapter Ei, Fart 3. 


Part 1 


In this E1IrSse Dare, five characteristics On the 
questionnaire Sample are examined with regards to the same 
Characteristics that are present in the Department of 
Defense. The characteristics examined are Age, Experience 
Level, RankyGS Rating Level, Type cr Procurement and Type of 
Gonmtrtact Most Encountered. Data for the Department of 
Defense, urless otherwise noted, was obtained from three 
sources: OASD (I and L), Report of the Long Range Manpower 
Policy Board, February 1969, OASD (Ccmptroller), Military 
Prime Cecntract Awards, Fiscal Year 1975 and The Repert of 
the Commissicn cn Government Procurement, December 1972. [It 
1s recognized that the sources of data pertaining to the 
characteristics of personnel in the procurement workforce 
cover the entire workforce, anecauding the “cont racer 
ad&@inistraticn ccmfonent. The questionnaire sample did not 
contain this camfonent. This factor was considered when 


drawing ccauclusions from the analysis. 


The statistical measure used in this part is the 
@h-oglare {Zx2), goodness of fit test. It is utilized to 
determine whether the questionnaire sample was selected from 
the DOD pepulation with a certain probability distribution. 
With this measure, the frequency distribution for our sample 
iS compared sith the frequency distibution expected if the 
BOD pPopulaticn probability distribution exists. This use of 
the Chi-Square is analogous to the use of the t-test tc test 
hypotheses ccncerning a population mean. Chi-Square is 


defined as: 
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ra 


a > 0;-€:)° 
= 


where QO, represents the observed frequencies and E, the 


expected frequencies. 


Before using the Chi-square test, certain conditions and 
assumpticns must be satisfied. First, one must assume that 
random sampling was used in obtaining the sample. In 
Chapter III, tke use of random number tables to chose sample 
participants was detailed. Secondly, the Observations 
shculd te independent of each other. Again in Chapter III, 
the methcd of guestionnaire administration was discussed. 
Responses tc the questionnaire were accomplished by each 
participant in his or her own work area, independent of any 
ether respendent. Thirdly, each expected frequency should 
be greater than one. In making the computations, some 
ccllapsing and grouping of response categories might be 
undertaken tc satisfy this condition. Lastly, the sun of 
the observed frequencies and the sum of the expected 
frequencies should be equal. in aber Ving “at. -Ene. 20D 
populaticn frequencies, data from the three aforementioned 
reports was converted from a frequency figure oe, a 
percentage and this percentage was then applied to the 
number of respondents in the sample for that characteristic 
to obtain the expected population frequencies. For example, 
in the case cf Type of Procurement, the data source (FY 1975 
Military Prime Cecntract Awards ) stated that 87.7% cf the 
wOtal Froctrement dollars, less Intragovernzental 
procurements, were negotiated, and 12.3% were advertised. 
Applicaticn cf these percentages to the sample total of 918 
yields the figures of 805 and 113 for negotiated and 
formally advertised procurements respectively. The same 


method was applied to the other four characteristics while 
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using the available data sources. 


An alpha (@) level of .05 was used and values for 
designating the critical region are presented fer eacn 
characteristic examined. In all cases the null hypothesis 
tested was that the sample selected (for that particular 
characteristic) was representative of the DOD population. 
The alternate hypothesis was that the sample selected suas 
not representative of the DOD population. 


~ 


A. Age 


fable 18 shows the Observed and Expected frequenciés for 
four age categories. The source of the expected data is the 


Report of the Commission on Government Procurement. 


TABLE 18 


Age Frequencies 


Category Observed Expected 
Zoe— 30 108 98 
21 = 40 204 188 
Se C 306 305 
s1 and cider PAS 320 
oy 917 
For 3 degrees of ‘freedom and xX equal to 0.05, the 


Mhi-oduare critical region is defined as 7.82 to infinity. 
ThEe Chi~Sguare for Age equals 4.62, and one fails to reject 
the null hypothesis eave the Sample selected was 
representative of the DOD population with regards tc its 


age. 
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Since the expected values are derived Tp eleti toe 
procurement wcerkfcrce in 1971, some shifting of frequencies 
mathe intervening years to the time of the OASD survey 
would be expected. However, the shifting of individuals 
would most likely ke into the younger age group, thrcugh the 
other grcups and out of the oldest age category. Such a 
shift would lend itself to a better fit tc the observed 


frequencies. 


B. Procurement Related Experience Level 


Table 19 indicates the frequencies for the procurement 
related experience level of the population and sample 
recpondents. source data 1s from the Report of the 
Ccm@issicn cn Government Procurement. 

TABLE 19 


Procurement Related Experience Frequencies 


Category Observed Expected 
Less than 1 yr Spe, aS 
Te=9> yrs 182 259 
Smet yrs 163 219 
Wom 20 Yrs 346 266 
Cver 20 yrs 183 ee) 
918 9138 


For 4 degrees of freedom, &{ equal to 0.05, the Chi~Square 
Critical regicn is defined as 9.49 to infinity. The 
Chi-Square value for procurement related experience is 
147.94 and the null hypothesis that the sample selected was 
representative of the DOD population with regards £0 


procurement related experience is rejected. 
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It shculd again be pointed out that the source of the 
Observed data is dated. Shifts in the expected frequencies 
would be expected, but would be difficult to predict. 
However, the cbserved and expected frequencies do follcw the 
same bimodai pattern with peaks at the 1 to 5 year and tne 
10 to 20 year categories. While the frequencies are not 
statistically alike, they do possess some Similar 


characteristics. 


C. Rank and GS Rating 


Table 20 provides the data concerning the observed and 
expected frequencies for the rank and GS ratings of the 
Sample and hypothesized population. Source of the expected 


frequencies is the 1969 Manpower Report. 


TABLE 20 


Rank/GS - Rating Freguencies 

Category Observed Expected 
C-2, GS-10 and below 149 433 
G=3,4, GS 11-12 414 378 
Gao, Go 13-14 203 96 
C-6, GS-15 and above 50 me) 
216 916 


For 3 degrees of freedom, and CA equal to 0.05, the 
@m-sSquare critical region 1s defined as 7.82 to infinity. 
The Chi-Sguare value for the rankyGS rating level is 
extremely large and the null hypothesis that the sample was 
representative of the DOD population with regards to rank/GS 
rating is revtected. However, it should be mentioned that 


the source data for the expected frequencies is [cr the 
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civilian ccmmunity only and is derived from the 1969 keport 


of the Long Kange Logistics Manpower Policy Eoard. 


D. Type Of Frocurement 


As cpposed to the characteristics of the sample and 
population individuals, two measures of the characteristics 
of the business being done by the questionnaire respondents 
were examined. These two areas were the type cf procurement 
(negotiated cr formally advertised) and the type of contract 
utilized (ccst-reimbursable Or fixed Price.) Other 
‘Characteristics such as the average dollar value per 
contract cr the average number of contracts experienced 
during a yéar, were considered to be possibly confusing ana 
sukject tc ambiguous. interpretation by the respondents. 
Type of procurement and type of contract were considered to 
be clear-cut and understandable to all questionnaire 
participants. Comparison of the sample figures to those 
representing DOD procurement actions were felt to be among 


the most accurate tests of Sample to population validity. 

Table 2Z1 provides the frequencies on the tyfe of 
prccurement experienced. Source data for the expected 
frequencies in both Tables 21 and 22 is derived from fiscal 
Year 1975 Military Prime Contracts Awards report. 


DASE 2 


Procurement Type Frequencies 


Category Observed Expected 

Negotiated 756 805 

Fermally Advertised 162 113 
919 $18 
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For 1 degree of freedom and fe, equal, «to:--0 “057° “the 
Chi-Sguare critical region is defined as 3.84 to infinity. 
The Chi-Sguare value for sample procurement type is 24.23, 
and the null hypothesis that the sample selected was 
representative of the DOD population with regards Lo 


procurement type experienced is rejected. 


Even though the null hypothesis is rejected, it may be 
reasoned that the heavier emphasis on necotiated 
precurements resulted from the inert nation Of the 
guestionnaire toward large activity procurements with their 


dependence on negotiation. 


Peel ype cf Contract 


Comal 


Table 22 presents the frequencies for type of contract 
used in the questionnaire sample and the hypothesized DOD 
population. The category "Other " which included such 
instruments as Blanket Ordering Agreements, was omitted from 


consideration. 


TASLE 22 


Contract Type Frequencies 


Category Observed Expected 
Fixed Price 633 647 
Cost-Reimbursement 262 243 
a35 e935 
For 1 degree of freedom and o4 CGUad. To, “Us0s, <tne 


Chi-Square critical region is defined as 3.84 to infinity. 


The Chi-Square value for contract type equals 1.09, and the 
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null hypcthesis that the sample selected was representative 
Geechee DCL pcpulation with regards to contract type utilized 


is rejected. 


Part 2 


im this seccnd part, the overall rating given to both ODCAS 
and the Plant Cog activities was compared to the resfonses 
given on éach of the functional guestions in that géneral 
category. The purpose of the analysis was to deteraine 
whether the ratings given to the individual functional 
guestions were independent of the ratings given in the 
overall guesticn. Since more than one attribute was under 
lnvestigaticn, a Chi-Sgquare test for independence was used 


to analyze tke data. 


The Statistical Package for the Social Sciences (SPSS) 
was used to ccmpute the Chi-Square statistic for each cf the 
questions, Hewever, statistical significance depends not 
cnly on the strength (ope the observed relaticnship 
(independent vs. dependent), but on the size of the sample. 
Since each respondent did not answer every question, the 
sample size varied in each comparison. Further tests of 
Statistical significance only indicate the likelihood that 
an observed relationship actually exists in the universe; 
they do net tell how strong the relationship 1s. For these 
Beasons, additional statistics to correct for sample size 
and tc measure the strength of the relationships were 


ccmputed. These statistics were: 
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Hien 4 gS Vo ror a2 ke “2 - contingency. staple. Vlad 
makes a ccrrecticn for the fact that the value of Chi-Sguare 
is directly fropertional to the number of cases (N) by 


adjusting the Chi-Sguare value. Its formula is: 


Phi takes on the value of Q when no relaticnship 
(independence ) exists, and the value of + 1 when the 
variables are perfectly related (dependence.) Although a 
universally accepted definition of the strength of this 
associaticn is not possible, Marascuilo [ 1 ] suggests the 


following guidelines: 


Strength of Association Range of Phi 
Weak 0 oes lo a epg Se re: 
Mcderate eS Son eer ae ee On), 
Strong 207) Phd (<0 


(ymmcencindeney Coefficient (Cont Coeff) = This 1s sakse 


a measure of association based upon the Chi-Square measure. 


Its formula is: a A 
Ce(in 
x +N 


The Contingency Coefficient has a minimum value of 0, but 
has a maximurm value of .707 when uSing a 2 x 2 contingency 
tackle. “cNemar [ 2 ) suggests that the Contingency 
Coefficient has a decided advantage over other measures of 


relationship since no assumptions involving the nature of 
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the variakles need be met. 


(3) Lamtda - This measure of associaticn determines the 
percentage cf improvement in our ability to predict the 
value of the dependent variakle once the value cr the 


independent variable is known. The formula is: 





Pa Max Ty -maxty 
AY N = maxty 


where & max tip represents tne sum of the maximum values of 
the cell frequencies in each column, and max fp represents 
the maximum value of the row totals. The maximum value of 
Lambda is 1.0 which occurs when prediction can be made 
without errcer, i.e., when each independent variabie category 
is associated with a.single category on the dependent 


Vaelvable. 


megendix FC, Tables D — 1 through D = 8, rerlects the 
statistical measures obtained by using a 2 x 2 contingency 
table. In the contingency tables, responses for each 
functional guestion and the overall question are compared 
With the responses categorized as either favorapdle or 
unfavorable with no comment or no answer responses cmitted. 
In all cases, the Chi-Square statisitc was used to test the 
null hypethesis that no relationship existed between the 
Variables (independence.) The alternate hypcthesis was that 
a systematic relationship (dependence) did exist. Since the 
SPSS program computed the actual levels of Significance, no 
prior assumptions were made concerning an acceptable level 
of significance. Thus, a level of significance of .0001 
would indicate that the cell frequencies deviate sc much 
frcm what would be expected under conditions of statistical 
independence, one would conclude that a systematic 
relationship does exist, although one would be taking a 


Chance cf being wrong one (1) time out 9f every 10,000. In 
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cther words, a table with as large a deviaticn from expected 
frequencies would cccur by chance in only one (1) sample out 
of 10,000. In this case, it could be said that the 


Chi-~Sgquare is statistically significant at the .000%1 level. 


A. General Ccntract Administration 


Table D - 1 #=$d.din Appendix D reflects the result cf the 
analysis for the ratings given DCAS in the General Contract 
Administraticn category. In all cases, one has to reject 
the null hypothesis that no relaticnship existed 
(independence), and accept the alternate hypothesis that a 
systematic relationship does exist (de pendence.) 
Furthermcre, in all-cases, this result was statistically 
Significant at a level of less than .0001. Using the Phi 
statistic tc measure the strength of the relationshif with 


tke adjustment fcr the number of cases provided the 


fcllowing results in accordance with Marascuilo's 
guidelines: 
Strength of Asscciation Number of Questicns 
Wea k 6 
Moderate 15 
strong None 


The results chtained for the Contingency Coefficient also 
generally demcnstrated a similar strength of association. 
The Lamktda statistic showed a greater variaticn. Its 
computaticn indicated that knowledge of the rating given tc 
a PUnCETOndad guestion would increase an individual's 
predictive ability concerning the rating given the overall 
Guestion frcem zero improvement or 0QO& to more than a 33% 


improvement. 
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taoec Deh ~ 2c Of Appendix D indicates the results cf the 
analysis for the ratings given Plant Cognizance activities 
in the Generali Contract Administration category. Using a 
level of significance of .05 for acceptance of tthe null 
hypothesis, it was determined that the null hypothesis wovid 
be accepted in two (2) cases while the alternate hypothesis 
would be accepted in all other cases at a level of 
Significance of .0002 or less. Use of the Phi statistic 


shcwed the fcllowing resuits: 


Strength of Association Number of Questions 
Weax 5 
Moderate 16 
SeLong None 


The Contingency Coefficient again verified tne results 
ocktained for Phi. However, the Lambda measure indicated 11 
questions where an individual's predictive ability would not 
shew improvement and only 2 questions where it would be 
akcve the 20% level. 


B. Producticn 


Table D - 3 reflects the results of the analysis fcr the 


ratings given DCAS in the Production category. In all 


cases, the null hypothesis that no relaticnship 
(independence) exists was rejected, and the alternate 
hypothesis that a systematic relaticnship does exist 
(dependence) was accepted. In all cases, this result was 


statistically significant at a level of less than .0001. 


The Phi statistic showed the following results: 





trength of Association Number of Questions 


2£25H pa2OScigtstonu 
Weak 1 
Moderate 16 

Strong None 


The Contingercy Coefficient verified the results obtained 
for Phi. The Lambda statistic demonstrated a much stronger 
improvement in the predictive ability relative to the rating 
given the overall question. Ten questions were 


characterized as above 30% in predictive improvement, while 


no guestions indicated zero improvement in predictive 
ability. 
Table D - 4 contains the results of the analysis fcr the 


ratings given the Flant Cog activities in the Production 
functions. In all cases, the null hypothesis that no 
relationship (independence) exists 1S rejected, and the 
alternate hypothesis that a systematic relaticnship 
(dependence) exists 1s accepted. In addition, in all cases, 
this result was statistically significant at tne level of 
less than .0601. The Phi statistic showed the fcllcwing 


results: 





strength of Association Number of Questions 
weak 1 
Moderate 16 
Strong None 


The Contingercy Coefficient verified the results obtained 
for Phi. The Lambda statistic did not show as stroeng an 
lmprovement in predictive ability relative to the overail 
rating as the cther three categories. Only 4 guestions were 
akcve 30% imprcevement in predictive ability, and again, none 


of the guesticns showed zero lmprovement. 
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C. Quality Assurance 


fTapbe  D-= 5) “of Appendixes D shows the results ct the 
analysis for the ratings given DCAS in Quality Assurance. 
In all cases, the null hypothesis that no relaticnship 
(independence) exists is rejected, and the alternate 
hypothesis that a systematic relationship (dependence) is 
accepted. In all cases, this result was statistically 
Significant at a level of less than .0001. Tie Pha 


statistic demcnstrated the following resuits: 


Strength of Association Number of Questions 
Weak -~- None 
Moderate 16 
Strong None 


mae addition to the above distribution, all of the Phi 


Statistics were above .50. The Contingency Coefficient 
Statistics ccenfirmed a strong association. The lLampda 
statistic démonstrated a much stronger improvement in 


predictive ability relative to the rating given the overall 
questicn. Every guestion was above the 30% level with 8 of 
them being akcve the 50% level. 


Table D - 6 indicates the results cf the analysis for 
the ratings given the Plant Cognizance activities in the 
Quality Assurance area. In every case, the null hypothesis 
that no relationship (independence) exists is rejected and 
the alternate hypothesis that a systematic relaticnship 
(dependence) does exist is accepted. To ale cases, this 
result was statistically significant at a level of less than 


-0C01. The Ehi measure showed the following results: 
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Strength of Association Number of Questions 
Weak None 
Moderate 16 
Seong None 


All of the Phi statistics were above .51. Furthermore, the 
Contingency Coefficient confirmed a strong association. The 
Lambda statistic demonstrated a strong improvement in 
predictive akility relative to the rating given the overall 
guestion. Twelve guestions were above the 39% level with 


three guesticns above 50%. 


D. Engineering 


_— 


Table C - 7, Appendix D, shows the results cf the 
analysis for the ratings given DCAS in Engineering. Ir all 
cases, the nuli hypothesis that nc relaticnship 
{independence) exists is rejected, and the alternate 
hypothesis that a systematic relationship (dependence) 
exists is accepted. In all cases, this result was 
Statistically significant at a level of less than .0001. 


The Phi statistic generated the following rfreguencies: 


Strength of Association Number gf Questions 
Weak None 
Moderate 11 
Strong > 


mhe Contingency Coefficient confirmed a strong association. 
The Lambda statistic also showed a strong improvement in 
predictive arility concerning the rating given the overall 
questions. All the questions were above tne 304 level with 


13 guesticns bFeing above 50%. 
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Table D - 8 reflects the results of the analysis fcr the 
ratings given Plant Cognizance activities in the Enginéering 
functions. In all cases, the null hypothesis that no 
relationsnip (independence) exists 1S rejected, and the 
alternate hypothesis that a systematic re lati ensnie 
(dependence) does exist 1S accepted. Again, in all cases, 
this result was statistically significant at a level of less 


than .0001. The Phi statistic showed the fcllowing results: 


Strength of Association Nuaber of Questions 
Weak None 
Moderate 15 
Strong Z 


The Contingency Coefficient confirmed a strceng association. 
The Lambda statistic demonstrated a strong improvement in 
predictive ability relative to the rating given the overall 
question. All the questions were above the 30% level with 8 
guestions abcve 50%. 


Part 3 


Pethis third part, theroverall rating given te, ‘both 
CCAS and the Plant Cognizance activities was compared to 
each of the demographic characteristics. A Chi-Square test 
for independence was used to analyze the data. The purpose 
of the test was to determine whether the ratings given each 
CAS compcnent in the overall question were independent of 
the demcgrafphic characteristics ot the guestionnaire 


respondents. 


Before the SESS Program could be used tO compute the 


Chi-Square Statistic. -and. the additiond!- Star1str1es, 1 £0 





measure tke strength of association and COLrecs for 
differences in sample size, certain data modifications were 
accomplisked. In uSing the Chi-Square distribution in these 
circumstances, one must be careful net to utilize categories 
having spall expected frequencies. Although “che’ Tusew of 
thumb in Chi~Square tests had been that the exfpected 
frequency should be at least five, recent research aas 
indicated that an expected frequency of one or more in each 
category is usually sufficient. [| 3 ] The sSimfliest 
method ef data modification to increase the expected 
freguencies fcr this test is to ccllapse two or nore 
adjacent or Simiiar categories. The revised categories are 
Shewn in Appendix DP. As in Part 2, contingency tables were 
constructed and the same statistics to measure the strength 
of associaticn were utilized with one exception, that of 
Phi. When Phi is catculated for a table which is net z x 2, 
it has ne upper limit. Therefore, since nost of the takles 
for Part 3 were larger than the 2 x 2 version, Cramer's V 
was used to adjust Phi for either the number of rows or the 
number cf cclumns in the table, depending upecn which cf the 


two 1S smalier. The formula fcr Cramer's V is: 


gt NG 
\ > min oe 1)(c-1) 


Cramer's V ranges from zero to +1 when several ncninal 


categories are invcived. 


In all cases, the Chi-Square statistic was utilized to 
test the null hypothesis that no relationship (independence) 
existed kretween the variables. The alternate hypothesis was 
that a systematic relationship (dependence) did ¢€xist. 
Since the SPSS program computed the actual level of 
Significarce, no prior assumptions were nade concerning an 
acceptable level OL Sigiat icanee- However, since 


Somainanrily, social scientists accept the .05 level. of 
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Significance as the value of alpha," [ 4 ] It was decided 
that this level would be used for the purposes of testing. 
It was also decided that one would consider the strength of 
associaticn when arriving at conclusions tased upon the 


testing and results thereof. 


Appendix F contains the data obtained using the 


aforementicned analysis. 


Ae. General Contract Administration 


Table F - 1 in Appendix F reflects the results cf the 
analysis for [CCAS in the General Contract Administration 
Gategory. in cnly four cases would the null hypothesis that 
the demographic characteristic was independent of the 
overall rating at the .05 level of significance be rejected. 
The four guestions pertained to the guestionnaire 
respondents! Service of the Activity, their Job Title, their 
Superviscry Status and Current Product Specialty. Further 
examinaticn of the statistics for these four guestioas 
indicate cnly a weak strength of association and only in the 
case of Jcb Title was there any increase in tne ability to 
predict the overall rating once the demographic 
Characteristic was known. This one increase was less than 
Ale 


Table FP - 2 reflects the results of the analysis fcr tne 
Plant Ccgnizance activities in the General C Om eaten 
Administraticn category. In all cases except one , the null 
hypothesis of independence would be accepted at the .05 
level of Significance. The question pertaining to Job Title 
Showed a weak degree of association with both Cramer's VY anda 
the Contingency Coefficient being just over .16. Further, 


Lambda indicated a weak association indicating that the 
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predictive ability concerning the overall rating would not 
show a statistical increase even if the respondent's Job 


Title was knecwn. 


B. Producticn 


Table F + 3 contains the results of the analysis for 
CCAS in the Froduction area. In only one case was the null 
hypothesis (independence) rejected in favor cf the alternate 
hypothesis that the variables were dependent. Both Cramer's 
Vand the Contingency Coefficient measured the degree of 
associaticn at just over .2. Lambda indicated that 
predictive ability, knowing the respondent's Job Title, 


would cnly increase approximately 2.7%. 


Table F ~- 4 ain Appendix F reflects the result of 
analysis for the Plant Cognizance activities in the 
Preducticn category. Ene only, ofe Case “was. the “null 


hypothesis (independence) rejected. The question pertaining 
to the Number of Employees Supervised indicated that there 
Was a degree of dependence. However, this questicn 1s 
somewhat misleading because one or the valid responses to 
this guesticn was that the respondent was not a Supervisor. 
Therefore, since one of the categories was tctally 
dissimilar frem the other, this question was considered 
invalid for statistical purposes, and was not analyzed 


further. 


C. Quality Assurance 


Table F —- 5 in Appendix F reflects the result of the 


analysis for DCAS in the Quality Assurance category. In 
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four or the cases, the null hypothesis (independence) was 
rejected in favor of the alternate hypothesis. The 
demographic characteristics of Job Titie,; Supervisory 
Status, Numker of Employees Supervised and Current Product 
Specialty represented the four rejecticns of the null 
hypothesis. The Number c£ Employees Supervised was 
disregarded fcr the reasons outlined above. Job Titte 
Showed the highest degree of association with both Cramer's 
V and the Contingency Coefficient being about 27%., Lambda 
indicated an improvement of over 9% in predictive ability. 
Supervisory Status and Current Product Specialty both showed 


g@mbesser degree of association. 


Table F - 6 reflects the result of the analysis for 
Plant Ccgnizance activities in the Quality Assurance 
category. In all caSes except one, the null hypothesis was 
easily accepted with most variables indicating a strong 
degree of independence. Job Title was the only variable 
Which met tke test for dependence, but while Cramer's V and 
the Contingency Coefficient showed a strength of association 
at the .22 level, Lamoda showed only a 14% increase in 


predictive ability. 


D. Engineering 


Table F - 7 contains the results of the analysis for 
CCAS in tke Engineering category. In two cases, the null 
hypothesis (independence) was rejected in favor of tuhe 
alternate hypothesis (dependence). Lype-~ Of AGCEIVity and 
Supervisery Status would both be considered dependent at the 
specified level of significance, but otner variables which 
met the test for independence still showed a greater degree 
of associaticn. AS an example, nine cther variaples showed 


an increase in predictive ability while still meeting the 
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test EOL independence. Job Title met the test for 
independence while showing a Cramer's V and Contingency 
Coefficient greater than .17 with an increase in predictive 


ability cf mcre than 92. 


maple fF .=-~"8 in Appendix-F reflects. the cesult cr tae 
analysis for Plant Cognizance activities in the Engineering 
category. Again, in only two cases was the null hypothesis 
(independence) rejected in favor of the alternate hypothesis 
(dependence.) Type of Activity and Average Dollar Value Per 
Contract were both considered dependent at the specified 
level of significance. Cramer's V and the Contingency 
Coefficiert were less than .2 in both cases with aa 
insignificant increase in predictive apility. Just as in 
the analysis of DCAS Engineering, cther variables indicated 
just as strong or- stronger degrees of association while 


still meeting the test for independence. 


Part 4 


To detertine if there was a significant difference 
between the cverall ratings given DCAS and Flant Ccgnizance 
activities in each category, the results cf the analysis 
were exagined trem two different perspectives. First, the 
overall results for the entire sampie were ccmpared on the 
basis of a favorable/unfavorable response. Secondly, the 
SPSS prccramn had the capability to select only those 
respondents who had evaluated both DCAS and the Plant 
Cognizance activities on the overali questions, thereby 
Giving a measure of "“head~+to~head" competition with an 
understandably smaller sample. The favorable/unfavcrabdle 


categorizaticn was again used. 


Table 23 reflects the results obtained when the entire 





sample was included. It should be noted that some 
respondents may have rated only DCAS or Plant Ccgnizance 


activities and not both. 
TABLE. 23 


Cverall DCAS / Plant Cog Ratings 
{Entire Sample) 








DCAS Plantscod 
Favor Untav No. Pavor Unfav No. 
Ccnt Admin 72.4 2556 5 86 Wo oe 2058 466 
Froduction 6755 SPP es 453 T2316 27.4 365 
Ca 64.0 56-0 445 TO 29 29> 
Engineering 46.9 5) 2 ae | 326 bo. 7 44. 3 264 


fable 24 reflects the results obtained when only the 
respondents who rated both DCAS and Plant Cognizance. 
activities were considered. The number in parentheses 
represents the number of respondents which net uolal fs 


Gmriterion. 
TASLESZS 


Overall DCAS Y/Y Plant Cog Ratings 
(Limited Sample) 


DCAS Plant Cog 
favor Unfavor Pavor Unfavor 
Cont Admin (384) 72.7% 2163 Td = Gm 22.4% 
Erod (297) 67.3% 32.7% Te 2€.3% 
Coa (243) 60.5% 39.5% 69.5% 30.5% 
EmGinw (203) 41.4% 58.6% Dihee ed 
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A cChi-Square test of homogeneity was used tc test 
whether there was a real difference of opinion concerning 
the perficrmance of DCAS and the Plant Cognizance activities. 
The Chi-Sguare test of homogeneity is an extension of the 
Chi-Square test o£ independence. It 1S, however, associated 
with dirferent problems. Tests of homogeneity are ccncerned 
with whether different samples (in our case, different 
degrees of satisfaction) really are hcomogenecus with the 
pepulation. This would mean that there is no real 
difference cf opinion among the respondents on the ratings 
given tc tke two types of CAS activities. Thus, the null 
hypothesis is that the favorable/unfavorable classifications 
are homogenecus insofar as the opinion of the respondents is 
ccncerned. Chou [ 5 J] suggests that "when we say things are 
hcmogenecus, we mean they have something in common or they 
are the same cr they are equai." The aiternate hypothesis 
is that the classifications are not homogeneous. In each 
case, a level cf significance of .05 was selected for the 
sane reasons cited previously. TACEELORe,. ‘the “nui 
hypothesis wceuld pe rejected if the computed Chi-Square 
value was creater than 3.84. The formula used to ccmrute 


the testing statistic was: 


R 2 

XO = > SN 
: a 
L=] 


where O;¢ was the observed response frequency, E,; tne 
expected resfonse frequency 1£ the nuli hypothesis stated 
previously was true and (N), the total number of respondents 


in a particular sample. 


The results of the above analysis to determine if there 
Was a significant difference in the overall ratings given to 
CCAS and to the Plant Cognizance activities in each category 


are summarized in Table 25. 
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TABLe 25 


Chi-~Sgquare Homogeneity Test 


Category “"gnegze gm Null © Eapisdd™ © on Null 
Cent Admin 6.52 Reject Ce Accept 
Froduction 2.45 Accept 1.34 Accept 
Gs A. . 3634 Accept 4.38 Reject 
Fnogineeriag 4.46 Reject o.06 Reject 


Only in the case of Producticn could the null hypothesis 
that the classifications are homogeneous be accepted under 
the criteria of both samples. Futhermore, only in the case 


of Engineering would-the null hypothesis in both samples be 


rejected. It could then be ccncluded that nomogeneity did 
not exist, and the ratings were not the same or equal. FOr 
both Contract Administration and Quality Assurance, 


corflicting results for the two sample were obtained. 
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This chapter fresentS a Summary of the results cf the 
analy$Sis performed in Chapter IV. Each part of the first 
pertion cf this chapter corresfonds to the same numbered 
part in the previous chapter. Based upon the analysis, 
certain conclusions will be drawn which reflect the views 
only of the authors of this research. In additicn, the 
second rortion Or this chapter Will provide some 


reccmmendaticns for further study. 


GENCLUSICNS 


Part 1 


ime Part 41 of Chapter IV, five characteristics of the 
users' satisfaction questionnaire respondents were ccuparec 
to the same characteristics present in the DOD procurement 
WORKEGECG DPOLUlaticn. Data more current than 1972 was not 
available. However, where possible, inferences on 
prejection of this data to the present are included in the 


summary. 


Of the five characteristics utilized, two (Age and fTyfe 
cf Contract) showed statistically that the questionnaire 
sample was representative of the DOD population. Of the 
other three characteristics which did not show this 
relationship at a statistically satisfactory level, ore of 


them (Prcocurement Related Experience) demonstrated a similar 
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bimodal distributicn pattern from which might be inferred 
scme relaticnship, although, not a statistically significant 
one. Of the two remaining characteristics, Procurement Type 
(Negotiated or PFormally Advertised) indicated for both the 
observed and expected frequencies, Negotiated frequency 
percentages in the 80's ( Negotiated cf Sample = 62.4%, 
Negctiated cf Population = 87.7%.) The final characteristic 
(Rank and GS Rating) demonstrated no statistical or 


inferable relationship. 


Based cn the above, it is concluded that the 
guestionnaire sample was representative ehia the DOD 


precurement werkforce. 


Bart 2 


A. General Contract Administration: For tae General 
Contract Administration category, the overall ratings given 
both DCAS and Plant Cognizance activities were dependent in 
all but two of the functional areas ({Adtinistraticn of 
Progress Payments and Surveillance SEV COntractor LAdust ria 
Security Ercgrams) upon the ratings given the individual 
functions. In the majority of cases, the strength of this 
associaticn cculd be termed moderate. It is therefore 
concluded that the overall rating was net arbitrary, but did 
reflect the ratings given in response to the functional 


guestions. 


GemerOducticn: The overall ratings given both DCAS and 
the Plant Ccgnizance activities were dependent in all cases 
upon the ratings given the individual functional questions. 
In almost all cases, the strength of this associaticn could 
be termed moderate with a general increase in predictive 
ability relative to the overall rating once the rating to 
any individual question was known. It is ccncluded that the 


cverall rating was not arbitrary, but was a reflection of 
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the ratings given in response to the functional guesticns. 


Greecuality Assurance: The overall rating given both DCAS 
and the Flant Cognizance activities were dépendent in all 
cases upon the ratings given the individual functions for 
Quality Assurance. In all cases, the strength of this 
associaticn coyld be termed at least moderate with ail but 
three of the thirty-two functional questions placing on the 
high side cf the moderate range. Twelve cf the thirty-two 
questions placed higher than .60. It is concluded that the 
6vetall rating iS nct arbitrary, but is a reflecticn cf the 
ratings given in response to the individual functicnal 


questions. 


D, Engineering: The overall ratings given both DCAS and 
the Plant Ccgnizance activities were dependent in all cases 
upen the ratings given the individual functions and 
retlected the strongest degree of association in all 
Statistical areas. Seven of the thirty-twe relationships 
were categorized as strong, and twenty-five of the 
thirty-twe placed cn the higher side of the moderate range. 
Lin 2s concluded that the overall rating for Engineering was 
net arbitrary, but was a reflection of the ratings given in 


response to the individual functional gquesticns. 


Ee summary ; In all four categories, General Contract 
Administraticn, Production, Quality Assurance and 
Engineering, the ratings given to the overall questions 


("Cverall, I would rate the performance or the 





ccorronent as:" are an accurate reflection or the responses 
given tc the individual questions, and represent the 
respondents’ evaluations of the applicable categories. tie 
other werds, the overall ratings are consistent with the 


ratings given in the individual functional guestions. 
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Part 3 


fn Part 3 of Chapter IV, an analysis was performed to 
determine if the cverall ratings for each of the functional 
categories was independent of the respondents' demographic 
characteristics. Although in each category for both DCAS 
and the Flant Cognizance activities at least one guéestion 
Showed that an association did exist, in none of these cases 
could the strength of this association be termed more than 
weak. While the overall ratings for each of the furctional 
categories was in these few cases dependent Uren a 
demographic characteristic, the strength of this association 
leads to the conclusion that the overall ratings were not 
influenced Ey the respondents! demographic characteristics. 
MimeOcner WClLdS, LE” 1s concluded that the personal 
characteristics of the questionnaire respondents, their 
activity, service, etc., did not bias their responses to the 


evaluation cf the [CAS and Plant Cognizance ferformance. 


Part 4. 


In Fart 4 of Chapter IV, an analysis was undertaken to 
determine if there was a Statistical ly Sigdiitcane 
difference in the overall ratings given the frour functional 
areas for the two types of CAS activities (CCAS and Plant 
Ccgnizance.) Chi-Sguare tests of homogeneity were run with 
two perspectives (Entire Sample and Limited Sample.) Based 
cn the results, it is concluded that there is a significant 
difference ir the cverall ratings given DCAS and Plant Cog 
activities in the Engineering category. There is not a 
Significant difference in the Production category. General 
Contract Administration and Quality Assurance demonstrated 


ecrflicting results. 
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MmeecoOMUENLATICNS FOR FURTHER RESEARCH 


While Ly me means inclusive, the Efoliowing 
reccmmendaticns fcr further research and investigaticn are 


suggested. 


(a) An Examination of the relatively low overall ratings 
given the Engineering category with emphasis on the 
contributicn cf éach individual question to the overall 


Eat Lng . 


(bo) Development of a standard by which the perfcrmance 
of the CAS ccmponents could be measured. At present, no 
guidelines e¢xist as to whetner a 70% faverable rating is 
acceptable as a level of performance satisfaction. 

(c) AM investigation of the differences between General 
Contract Adginistration and Engineering, the functional 


categories havinc the highest and lowest favorable ratings 


respectively. The investigation could include in-depth 
interviews with individuals within the varicus DOD 
activities, and the gathering cf Suiggesticns fOr 


Lmaprovement/modification of policy and procedure. 


While the above areas for research do nct by any measure 
exhaust the possibilities for further work, they do pcint 
out some areas that do exist. An extensive amount orf data, 
gathered frcem the guestionnaire effort exists as a base for 


further reséacch. 
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AUP END 7k 


ASPR 1-406 


This appendix contains the Parsi of GOutracr 
administraticn functions taken from the 1975 Edition of the 


Armed Services Procurement Regulations, (ASER 1-406.) 


(1) ceview ccntractor's compensation structure; 


(113) review the ccntractor's insurance flans; 


(111i) review and approve or disappreve contractor's 


reguests for payments under the progress payments clause; 


(iv) determine the allowability of costs suspended or 
disapproved cna CCAA Form 1 when a written apreal has been 
received frcew the contractor, direct the suspensicn or 
disapproval of any costs when there is reason to believe 
that they shculd be suspended or disapproved, and afprove 


final vouchers; 


(v) negotiate billing and final overhead rates when the 
contract ccntains the clause in 3-704, except when 
negotiaticn responsibility is placed elsewhere in accordance 


With Departmental frocedures; 


(vi) negotiate understandings consistent with agreements 


negctiated under 15-107 applicable to treatment of costs 
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under contracts currently assigned for administraticn; 


(¥1il) negotiate prices and execute supplegental 
agreements fcr spare parts and other items selected through 


PleCviscicrigctg procedures; 


(viii) review and evaluate contractor's proposals in 
accordance with S-00 I (5) and furnish comments and 
reccmmendaticns to the procuring contracting officer when 
negotiaticn Will be accomplished by Ene AplOcuring 


CoumEacting cfficer; 


(ix) when authorized by the purchasing office, negctiate 
or negotiate and execute supplemental agreenents 
inccrperating contractor proposals resulting frem change 
orders issued under the Changes clause (Prior to ccmpletion 
of negotiaticns and issuance of the supplemental agreement, 
any delivery schedule shall be coordinated wep the 


Pumehasing cffice.) ; 

(x) manage special bank accounts; 

(xi) assure timely notification by the ccntractor cf any 
anticipated cverrun or underrun of the estimated cost under 


Ceetetype CORtracts; 


(xii) ceview, approve or disapprove and maintain 


surveillance cf the contractor's procurement systen; 

(xiii) ccnsent to the placement of subcontracts; 

(xiv) Menecr FoontractoOr >  Cinancial <gconds tion, and 
ad@wise the procuring contracting officer when contract 


performance is jeopardized thereby; 


(xv) when authcrized by the purchasing office, negctiate 
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prices and execute priced exhibits for unpriced crders 
mooued by the procuring contracting officer under basic 


crdering agreements; 
(XxVi) issue tax exemption certificates; 
(xvii) ccnduct poSt-award orientation ccnferences; 


(xviii) issue work requests under Maintenance, overhaul 


anaemodltricaticn ccntracts: 


(xix) negotiate and execute contractual documents for 
settlement of partial and complete contract terminations for 


convenience, except aS otherwise prescribed Ey Section VIII; 


(Xx) perform necessary screening, redistributicn and 


disposal cf centractor inventory; 
(MX) perfckm prorerty administration; 


(xxii) prepare findings of fact and issue decisions 
under the Cisputes clause on matters on which the contract 
administraticn office has the authority to take definitive 


action: 


(xxlii) assure processing and execution of duty-free 


entry certificates; 


(22704) 10 facilities contracts—— 

{A) evaluate contractor's requests for facilities 
aod changes to existing facilities, aad provide the 
Peocuring contracting officer with approfriate 
reccmmendaticns thereon; 

(2) assure required screening of facility items 
DetoberaCGULSItlcCn. EY contractor ; 


(C) approve use oe facilities cn a 
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noninterference basis in accordance with paragraph (f£) of 
the clause in 7-702.12; 

(CL) assure payment of any rental due; and 

(E) assure reporting of items no longer needed 


for defense prcduction; 


(xxv) perform production support, surveillance, and 
status reporting, including timely reporting ofr fetential 


and actual slippages in contract schedules; 
(xxvVi) perform pre-award surveys; 


(xxvii) perform industrial readiness and mobilization 


production flanning field surveys and schedule negotiations; 


fexyili) Monitce ‘contractor industrial labor relations 
matters under the GONtCEact, apprise the PEOGUrInG 
contracting officer and cognizant departmental labor 
relations advisor of actual or potential iabor disputes; and 
coordinate the removal of urgently required material from 
the strikebcund contractor's plants upon instructions fron, 
and authorizations of, the procuring contracting officer and 


the cognizant departmental labor relations advisor; 
(xxix) perform traffic management services including 
issuance and contrcl of Government bills of lading and other 


transportaticn documentation; 


(xxx) review the adequacy of the ccentractor's traffic 


SPerat LOns ; 


(xxxi) review and evaluate preservation, packaging and 


packing; 


(xxx tly provide «isurvelilance™, of cConttdcror design, 


development, and production engineering effcrts; 
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(xXxXili) review engineering studies, design, and 
prcposal, and make recommendations to the system/project 


Manager Or perchasing office; 


(xxx1lv) evaluate and monitor contractor engineering 


eftferts and expenditures in accordance with contract terms; 


(xxxv) cCccnduct surveillance of contractor engineering 


BEactices With regard to subcontractors; 


(xxXXV1) review, on a continuing basis, contractor test 
plans and directives for compliance with contract terms; 
ccmpare tilestcnes; progress, and cost against contract 


requirements; 


(xxxvii) assist i alasstrication Clk walyers. ‘dnd 


deviations; 


(xxxviii) evaluate the adequacy ond Centracr on 
engineering cata ccntrol systems, including assurance that 
systems previde for timely incorporation cr changes in data 


being acquired; 
(xxxixX) EeCniLtcr contractor value engineering prograns; 


(xl) review cost reduction profosals, and submit 
ccmments regarding efrrect of proposed changes cn the 


engineering requirements of the contract; 


(xli) evaluate and perform surveillance of contractor 


cOonzriguraticn management systems and procedutes; 


(xlii) perform surveillance of contractor engineering 
change systers; review Class I engineering change propcsals, 
and comment on engineering feasibility and need; assist in 


price analysis cf engineering changes; review Class MII 
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engineering changes to insure proper classification; 


(xliii) evaluate the contractor management, flanning, 


scheduling, égnd allocation of engineering resources; 


(xliv) evaluate and monitor contractor reliability and 


Maintainability prcgrams; 


(xlv) review and evaluate for technical adequacy the 
logistic support, maintenance, and modification pregrams 


acccmplished ky the contractor; 


(Xlvi) take appropriate comments to purchasing offices 


On any inadequacies noted in specifications; 


(xlvii) perform Procurement quality assurance; 


(xlviii) maintain surveillance of flight operations; 


(xlix) assure contractor compliance with applicable 


safety reguricments; 


(1) assure contractor's compliance with small business, 
larkcor surplus area, and minority business enterprises 
mandatory sukcontracting programs; Gonducciag, Men aan 
as-~required rasis , small business and labor surplus area 
set-aside surveillance; and providing advice to small 
business, lakor surplus area concerns, and minority business 


enterprises; 


Meise if Connection with classified contracts, administer 
these porticns of the Industrial Security Program desicnated 
as ACO responsibilities in the ISR and ISM (See Appendix C, 
Mmodustrval, — Security Regulation, DoD 5220. 22-8, EOE partial 


listing cf primary responsibilities (also see 1-320) .) ; 
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(111) make payments on assigned contracts (but see 
20-706) ; 


(1111) assign and perform supporting administration; 


(liv) assure timely submissicn of required reports; 


(lv) will advise and assist defense contractors 
regarding their priorities and allocations responsibilities 
and assist defense purchasing activities in processing 
reguests for special assistance and for priority ratings for 


privately-owned cafital equipment; 


(lvi) precess and execute novation and change of name 
agreements in accordance with Section XXVI, Part 4; 

(lvii) when authorized by the purchasing OEE ice, 
negotiate or negotiate and execute supplemental agreements 


accelerating cr decelerating contract delivery schedules; 


(lviil) when authorized by the purchasing office, 
negotiate or negotiate and execute supplemental agreements 
providing ep 6 the de-obligation of unexpended dcllar 


balances considered excess to known contract requirements; 


{ I a6x;) determine adequacy of prime COntrac tor. > 


Disclosure Statements; 


(lx) determine whether prime ccntractor's Disclosure 
Statements are in compliance with Section XV and Cost 


meeccunting Standards; 


(lxi) determine Con tractor compliance gith EGSe 
Accounting Standards and Disclosure Statements, nee 
applicable; 
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(x1) negotiate price adjustments and execute 
Supplemental agreements pursuant to the Cost Accounting 
Boacandards Clause in 7-104.83; 


(iey21) perform post award surveillance of contractor 
prcgress tcward demonstration of Cost/Schedule Ccntrol 
Systems tc meet the CostySchedule Control Systems Criteria 
(see 7~104.E7), provide assistance in the review and 
acceptance of contractors! Cost/Schedule Control Systems, 
and perforn post~acceptance surveillance to insure 


continuing oferation of contractors' accepted systems; 


(lxiv) when authorized by the purchasing office, issue 
amended shipping instructions and, when necessary, negctiate 
and execute supplemental agreements inccrporating ccntractor 


prceposals resulting from the amended shipping instructions; 


(lxv) when authorized by the purchasing office, issue 
change ecrders and negotiate and execute resultant 
supplemental agreements under contracts for ship 


constructicn, conversion and repair; 


(AV 1) issue COntrace. MOdtEilcallons | Eequirine. -tne 
Someractcr tc previde packing, Crating, and handling 
Services on excess Government property. When the ACO 


determines it to te in the Government's best interests, he 
may secure such services from other than the contractor in 


possessicn of the property; 


UExXyii)), -AEOrOve- (COntrEacCtOr acqulsition/fabricacion of 
special test equipment as provided in paragraph (b) of the 


clause in 7-104.25; 
(lxviii) negotiate and execute contractual documents for 


settlement eed cancellation charges under multi-year 


procurements; and 


we 





(lxix) evaluate and monitor contractor's procedures for 
complying with the "Restrictive Markings on Technical Data" 


clause in 7-104.9(f). 
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APPENDIX B 
SAMPLE QUESTIONNAIRE 


OFFICE OF THE ASSISTANT SECRETARY OF DEFENSE 
WASHINGTON, D. C. 20301 





9 January 1976 


LATIONS AND LOGISTICS 


MEMORANDUM FOR The Contract Administration Study Participants 


SUBJECT: Contract Administration Improvement Study 


The Assistant Secretary of Defense (Installations and Logistics) has 
formally announced a major study of the Defense Contract Adminis- 
tration function in order that improved policies may be developed 
which optimize manpower resources to accomplish essential tasks. 
We have established four study teams to provide recommendations 
which will improve government utilization of resources, provide con- 
tract administration policy improvement, recognize Defense-Industry 
concerns. and survey government buying activities to ascertain 
satisfaction with the variety of services currently provided. 


You have been selected for participation in this study effort. The en- 
closed questionnaire has been devised by the Navy Post Graduate 

School, Monterey, California, to gather information relating to the 
government buying office/contract administration office interface. 

They will classify, analyze and prepare the results of the questionnaire 
into a major portion of the Contract Administration Improvement Study. 
An OSD/RCS number has been secured and your candid views are needed. 


The questionnaire is in two parts. PartI, requests you to provide 
certain information about yourself and your experiences in the pro- 
curement process, Your name is not required and replies will be 
coded to ensure the confidential nature of your responses. Part HU, 
lists the basic contract administration functions divided into the four 
general categories of general contract administration, production, 
quality assurance and engineering. 


The data obtained during this survey will be used to determine overall 
DoD buying office's satisfaction with the services obtained in the user- 
customer relationship. Your complete support is requested. 
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QUESTIONNAIRE DIRECTIONS 


In questions (18-23), on the previous page, you indicated your experience 
in dealing with the various contract administration organizations. Your satis- 
faction with the CAS functions listed on subsequent pages should be made in 
consideration of your answers to those questions. 


The following portion of the questionnaire consists of four major categories 
of functions/questions. For each category, you should first quickly read the 
functions/questions in that category and determine whether you are sufficiently 
experienced in that functional area to respond meaningfully. If you do not 
feel qualified to evaluate the functions in that category, please indicate this 
by marking the block next to the statement, "I do not have sufficient experience 
in this category to evaluate the following functions", and then go on to the 
next category of questions. 


If you feel sufficiently experienced to evaluate the functions in that 
category, the following directions apply. Each function has three response 
areas to be answered. The first two areas address your satisfaction with the 
performance of the Defense Contract Administration Services (DCAS) and the plant 
Cognizance contract administration organizations (Army Plant Activity, NAVPRO, 
AFPRO). The third area asks for your opinion if that function could be performed 
better by the buying office/requiring activity. 


In each of these response areas, you are asked to indicate your evaluation 
of the DCAS and Plant Cognizance performance of the function by marking the 
block that best describes your evaluation. In the response areas, space is 
available for a “No Comment" answer. If you do not have sufficient experience 
to evaluate the performance of the organization for that function, or have too 
few observations of their performance in that area, please indicate this by 
marking the block under ‘No Comment". 


Finally, space has been provided after each category of functions for your 
written comments. While the purpose of the questionnaire is to measure your 
Satisfaction with the organizations that perform contract administration, your 
Suggestions for improvements and comments of a general or specific nature are 
strongly encouraged. If your comments are directed toward a particular function, 
please reference the function number in your comments. Additionally, the reverse 
Side of the page may be used for comments. This is your opportunity to indicate 
your satisfaction with the caliber of services provided by the contract adminis- 
tration services. 


After completion of the questionnaire, place it in the envelope provided. 
Do not staple or fold the questionnaire. 
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Could the function 

be performed better 

by the Buying Office 
Requiring Activity 


How do you rate the 
performance of the 
Service Plant Cogni- 
Zance Organizations 
(Army Plant Activity 
NAVPRO, AFPRO) 















How do you rate the 
performance of 
Defense Contract 
Administration 
Services (DCAS) 


USE SOFT 
LEADED PENCIL 
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a Only 









USE SOFT 
LEADED PENCIL 









2 
unctions 


have sufficient experience in this category to evaluate the 
functions. 













5 technical analysis of Cost/Schedule Control Systems Criteria 
). 


5 contractor production capabilities in Pre-award surveys. 








5 contractor production plans. 





notification to buying offices of anticipated or actua! contract 
delinquencies. 


technical analysis of contractor cost proposals. 





notification to buying offices of potential or actual labor 






s surveillance of contractor integrated logistics support man- 






the contractor make or buy program. 





re. 
— 






assistance to contractor regarding priorities and allocation in 
g material purchases. 


Industrial Preparedness Planning. 







5 contractor scrap and rework program. 






various traffic management services. 





advice to the buying office on all pertinent matters relating to 
bn functions. 


onsiveness of the production component to requests for infor- 
d/or assistance is considered. 


ing relationships of the oroduction CAS component with the 
br is considered. 


ning (number of personnel and grade level) in the production 
nt is considered. 


nical expertise of personnel in the production component is 
ed. 


would rate the performance of the production component as. 















reverse side if necessary) 
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Excetlent 


. Satisfactory 
_. Needs tmprovement 


& -.-3 


How do you rate the 
performance of 
Defense Contract 
Administration 
Services (DCAS) 


Oi 


Unsatisfactory 
»No Comment 


How do you rate the 
performance of the 
Service Plant Cogni- 
zance Organizations 
(Army Plant Activity 
NAVPRO, AFPRO) 









Could the function 
be performed better 
by the Buying Offic 
Requiring Activin 
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a Only | 
Could the function 


be performed better 
by the Buying Office 
Requiring Activity 


How do you rate the 
performance of the 
Service Plant Cogni- 
Zance Organizations 
(Army Plant Activity 
NAVPRO, AFPRO) 
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ROP ENDIX CG 


ADDITIONAL RESPONDENT CHARACTERISTICS 


diy: op Op ones Cea: | 


Fresent Assignment Experience Level 


Category Respondents Percentage 
Less than 1 YR 84 o% 
1 - 3 YRs -~ 253 27% 
Gee 5 YRs 116 13% 
5 - 10 YRs 208 23%, 
Over 10 YRs Zou, 28% 
918 100% 


DAT Eee = 5 


Frocurement Related Experience Level 


Category Respondents Percentage 
Less than 1 YR Sys; 4% 
lino: YRS 182 20% 
eee Ol Y Rs ie3 18% 
om .2C XHSs 346 38% 
Cver z0 Ys 183 20h 

918 100% 


8 1 





Respondent Product Specialty 


Category 
Ap@ecratt, Mis¢iles 
ELSCuLccnic 
Services 

Shipbcard 
Mechanical 
Automctive 
Constructicn 
Electrical 


Fuel 


Other ins 


TABLE ee = 


i ae SE Se ee 


G10 


TA Bie Crs 


3 


~ 


100% 


Contract Type Most Often Encountered 


Category 
FP 
Pei * 
CeErr 
CPIF 
CPAL 
Other 


Respondents 


82 


48 3 
jes6 
129 
V23 
10 
23 
918 


Remeomtame 

S35 

16% 

14% 

13% 

ibe 

38 

100% 





ADPENDIX D 


PABISS = 1G 0) 3 


Key tc Independent Variable Abbreviaticns 


Peest. and Second Alpha Characters: Functional Category 


ca = General Ccntract Administration 
pd = radeon 

ga = Cuality Assurance 

en = Engineering 


Numeric Characters: Refers to the number of the question on 
questionnaire in the applicable 


functional category 


DCAS 


Plant Cognhlizance ACEAv ices 


Last Alpha Character: a 


S 
tl 


83 





Indep 


ca2za 
ca3a 
ca4a 
ca5a 
ca6a 
cala 
ca8a 
ca9a 
calQ0a 


calla 


cali2a -° 


cal3a 
cal4a 
cai5a 
cal6a 
calla 
calsa 
Gata 
ca20a 
ca2ila 


ca22a 


Cha s= 
Sguare 


12252565 6 
57.95462 
O02 9205 
36.2646 € 
SE Peotope’ 
Zee01t29 
124.59805 
5€.3784€E 
74.76306 
40.61003 
4.15308 
ay. Pe spays ee 
46.59720 
Pa Foes se 0) 
WAST S006 
easel 
110. 08496 
Tse 8253 4 
1862415 (54 
14.72088 
141.64117 


Deis D4 


Signit 
.0 
.0001 
0001 
.0001 
.0001 
0001 
0 
0001 

0001 
. 0001 
0001 
.0001 
.0001 
0001 
.0 
.0001 
0 
9 
.0 
.0001 
.0 


GENERAL CCNTRACT ADMINISTRATION - 


Phi 

Poa eile: 
soe 023 
Se SE yags. 
w29700 
-40400 
- 30741 
22 0u> 
oo1521 
243044 
wo 73) 
- 36904 
~ 37824 
sa 0o 1 
eo yt 
243387 
s22020 
eto 2 od 
249457 
251147 
220315 
2 200i), 


84 


Cont 
Coeff 


~-456063 
s5002-2 
2350459 
a2) 3) 210) 
237459 
~-293E4 
~-46188 
poe 37 
woo 55) 
229500 
~ 34622 
so 5576 
034330 
ecg 
poo 6 OZ 
24278 
oe 199% 
rue 2 
~-45536 
1990S 
~46544 


PCAS 


Lagkda 
.33871 
17949 
.18407 
.11504 
mri, 
.03947 
~13953 
.19626 
. 19492 
.02500 
.14634 
ROS SOs 
0 

.06349 
20714 
On ane 
.07534 
ng 20 
.32877 
.0 

,22378 





Gonehal CONTSZACT ADMENISTRATION — 


Inde 
var 


ca2b 
€aJb 
ca4b 
ca5b 
ca6b 
ca7vb 
cas8b 
ca9b 
cal0b 
calib 
cal2b 
cal3b 
cal4b 
cai5b 
cai6b 
cal7/b 
caisb 
cal9bp 
¢ca20b 
ca2ib 
eaZzZb 


ish = 
Square 


107253133 
4 2.78000 
$$.14893 

2259694 
37.99406 
§5.84813 

eo 9 35.2 
SA ep eisiel 
4C.68512 
JES 25495 
27.47548 
Hee 0363 2 
“5.29175 
14.56896 
54.94803 

2 10039 
GS&E.48688 
Ges 1826 
O25 2035 
Zeectso 9 
94.03899 


TABLED. = 2 


-0001 
- 0 


Bhi 
~-54684 
-40688 
Noes OS 
~10411 
S3a256 
~45204 
56079 
-441383 
35955 
~- 34336 
aS PAL AB go) 
~-42670 
2300 57 
e230 00 
Bn Was he) 
-04210 
49237 
e477 2038 
~-46591 
Bos PO! 
~48229 


85 


PLANT COG 


Cont 
CoeEtt 


<4/979 
=o 106i 
-46667 
210355 
235.) 16 
eo 1194 
-49310 
40414 
- 33834 
232475 
so 0269 
~ 39247 
Hpoilok oi) 
a JO 
239454 
-04206 
244173 
ud fea 
eee Se 
2 
43440 


— ss —— a 


20 


Os GZ 
BLS sh) 
a0 


Q 
9 
0 
0 


a8, 
Pe) eins, 
-U6750 
0 
1) 
205495 
W220 
=x6) 
-10465 





Indep 


pd2a 
pd3a 
pd4a 
pd5a 
pdéa 
pd/va 
pd8a 
pd9a 
rd10a 
pdila 
pdi2a 
pdil3a 
pdil4a 
pdi5a 
pdl6a 
pdiva 
pd18a 


Chi-= 
Square 


D467 949 
Tea 16.6 
Pi2s32 i354 
87220305 
107.68127 
27.64354 
cia Pee pole ite 
7135-30105 
64.21870 
471.33670 
47.97316 
24.647174 
Sea te Zo 0 
144.62407 
U2Z.0) ti 
O00 Z67) 
13€.5411714 


TABS Des 


Signif 
0001 
0001 
216 
a0) 

0 
FOG.0 
0 
~0001 
~~ .0001 
.0001 
OKO 
20007 
0 
0 
= 
.0001 
0 


PRODUCTION == DCAS 


Phi 
.49419 
a 
.54181 
.45271 
~54831 
. 27547 
.61179 
.53956 
.44370 
.52375 
44456 
. 33482 
.62470 
.58758 
.49593 
.37400 
.59650 


R6 


Cone 
Coefi 


244304 
~40560 
247646 
241244 
-48078 
S25050 
-o2 lot 
47485 
- 40938 
10 3.96 
~40623 
Posi lesan’. 
Ras aco 
220 0G" 
444729 
«39030 
oe Pas, 


tae Ee 





TABLE Do-6d 


PRODUCTION 

Indep Gia = a 
Var Sguare signit 
pd2b 27. t4941 0001 
pd3b 4 2.63321 0001 
pd4b 7Z.79280 .0001 
rd5b §3.73154 =O 
rd6b 8.95067 £0 
crd7b 26.50732 -0001 
rd8b 30.79951 0001 
pd9b 33.38100 0001 
rd10b 42.88136 .0001 
pdit1b 16.7590 2 0001 
pdi2b 43.50279 .0001 
£da13b 26.35760 0001 
rdi4b 126.98576 IG 
pdi5b 120.68857 70 
od16b 7&.04280 .0001 
brd17b 70.83472 .0001 
rd18b 127.44360 0 


- PLANT COG 


Phi 

oe iS 
EAB |S /9).) 
220207 
nese © 
~5 1588 
S019 4 
a9 an 0 
#37093 
- 43501 
750209 
42194 
-31064 
-62166 
00244 
29 1520 
-95438 
204398 


Sa. 


COnt 
Coeff 


- 23966 
oC 1.64 
-44 866 
-44888 
~45847 
725903 
oo 7 2 
~-34778 
Pelee ch) 
- 34096 
241184 
oy One 
ep ai4 IESE. 
721003 
oe 9 
48486 
~94443 


Lamrda 
03448 
17353 
a2 9266 
Pe io a | 
Pa ge 
12346 
S055 74 
BOY 246 
20035 
elose> 
-16949 
~19298 
~-40000 
~43617 
20 568 
eA WS 
~48364 


a vi — 


665 e— 64 


seeee ste. 











indep 
Var 


ga2za 
ga3a 
ga4a 
ga5a 
ga6a 
ga/va 
ga8a 
ga9a 
galQa 
galla 
gai2a 
gat3a 
gai4a 
gai5a 
gal6a 
gai7va 


TABLE D- 5 


QUALITY ASSURANCE - DCAS 


165.60324 
167.11548 
Tere 69235 
133616035 
155-000 10 
118.84140 
100.€3254 
$7.15544 
See03 22.1 
Tie. 631635 
WO? 55716 
129.4500 1 
142.48566 
11i7.S4E12 
Seu gJes 9 
le2ec0co4 


syoke Sule aa 
-0 
ae) 
- 0 
0 
#0 
a0 
a0 
20 
20 
20 
Ae 
oO 
510 
0 
.0001 
a0 


Phi 
6 2235 
.62701 
. 6 2286 
.62511 
.66195 
.55804 
259449 
.51871 
54691 
.55408 
.56048 
.57059 
.58788 
.55979 
.50332 
.6 2732 


88 


COG 
Cocker 


sozeoo 
Res) 2) ea 
252869 
moo) ONO | 
phos 
-48730 
oye ey ele 
46045 
47984 
~-48466 
0483892 
4955S 
-50680 
048846 
44958 
253141 


Lamkaa 
SWS 
52866 
NS) (S4) 
US) 27a 
57895 
45000 
50450 
~33099 
530392 
439885 
46324 
43151 
43684 
44361 
34615 
52482 





Indep 
Var 


ga2b 
ga3b 
ga4b 
ga5b 
qa6b 
ga7b 
ga8b 
ga9b 
gai0b 
gattb 
gal2zb 
gail3b 
gai4b 
gai5b 
gal6b 
gal7/b 


TABLE 


D> =6 


CUALITY ASSURANCE - PLANT COG 


Chi i= 
Square 


ils 5S 4 
119.1854? 
105. 15413 
71.04€31 
Ee? 70 
74.80908 
ett Z29 9 
J3e03099 
46.75279 
TO 213521 
57.40215 
S272, 43924 
11£.94626 
t32097 43 
4¢.28579 
o2.c7 0350 


Signift 
0 
x0 
0 
0001 


~0001 
-OUOT 
©0001 
-000 1 


~~ 0001 


—,00Q1 
.0 


~ 0001 
-0001 
a0 


Phi 

sO 273¢ 
~65647 
264214 
soy 
-601447 
se SZ 
re 0 
~49418 
~47134 
-52868 
ooo ia) 
soo I719 
~-64809 
-93487 
pod D7 
-60640 


89 


Cont 
Soci 


poo 4S 
-94878 
~5 4033 
~46655 
Fee) ys eI 
a0 Sol) 
-45663 
~ 44304 
~42636 
-46738 
44082 
s20 7165 
-54386 
-47164 
245544 
Bao soia 


Lambda 
47674 
52941 
251899 
.36709 
46667 
~42647 
.35938 
127 500 
12903 
.37333 
.29167 
.39024 
.52381 
.37333 
.26667 
me a ey, 





Indep 


enza 
en3a 
en4a 
end5a 
en6a 
en7va 
-en8a 
enda 
eni0a 
enlla 
eni2a 
ent3a 
ent4a 
eni5a 
enl6oa 
enlva 


Chis 
square 


VeriacOi23 
86 .44595 
74.911324 
OSs SS 10rs 
hig 2eoo 1s 
48.81133 
140.6€1043 
89.66776 
61.6949 3 
116. C8440 
OEIC 12 3 
loos 17993 
75241344 
63.71004 
79.54813 
leZc0c064 


ghey 03g Pg 9 ae! 


Signit 


-0 
-0001 


- 0 
-0001 


- 0 
-0001 
-9 
-0001 
0 
, 29007 
~0001 
-00U1 
ay!) 


ENGINEERING - DCAS 


Phi 
~71100 
~-599859 
-56408 
Ooo 
- 64896 
~-49681 
13450 
Oma 
Mis hs hove ns) 
~69509 
SG0M25 
me ee 8) 
Ps fel Woo) 
~49471 
~01470 
Pee ie We 


90 


Cone 
Coeff 


277 346 
Peo eee ad 
~- 497430 
~94724 
~54437 
44493 
Ra holy 
Saco 
~48754 
Peso) vis 
solo ZG 
-61178 
45614 
44342 
sO 2567 
pes oo 


ots eee) 
-98416 
wieoe 2 





Indep 


en2b 
en3b 
en4b 
enob 
en6b 
en7vb 
engb 
en9b 
entdb 
enlla 
eni25 
enl3b 
eni4b 
en15b 
enlob 
eni7b 


Lee bee Dome 


ENGINEERING ~ PLANT COG 


cha 
Square 


Sooo 2] 
66.16103 
42.02200 
Ti. 12006 
96 e434 5:5 
Re 0gs 5 
101.0307€ 
62.41685 
wae SZ so 
66.57123 
6¢.93484 
102. 26224 
2) Giope le eal 
55.2244 7 
44.55423 
iG. eee Z5> 


Signit 


20 
-0001 
~ 0001 
~0001 
~ 0 
-Q001 
- 0 
-0001 
-0001 
-0001 
-0001 
2) 
- 0001 
-0001 
-0001 
0) 


Phi 

nod 
Boy syeks)S 
~-45809 
-OUGD2 
-66030 
~-45069 
-67755 
Bis oye el 
~49914 
so2 008 
29845 
-66443 
20 160 
mo os 
249353 
pi 46 


a0 


Cont 
Coeftr 


292447 
-48784 
241647 
-21984 
oo 2 
410283 
PO 2G 
~484U55 
~-44660 
2498733 
Pea) |W \.3)/ 
soo 44 
~-44835 
44547 
44257 
-20G3 1 


s+ 1053 
© 55435 
S636 
- 36620 
-6 1000 
-47778 
Bay bo go\s 
47826 
so 4545 
-61765 
gH 3115 
o42574 
-44186 
65774 


- Oo 


a 7 - 


: 


: oe 6 8S Fie 





APPENDIX §& 


DEMOGRAPHIC REGROUPING 


2. dype of Activity 
Systems ccmmand 
Buying activity 
Requiring Activity/Progran Office/Project Office 
DepotyIcF/Center {includes: Stock Point, Depot, 


Center, and Others) 


35 Service of Activity 


= a ee ce ke SSP EP <P ae 


Service (includes: Army, Navy, Aix Force) 


Precureméent (includes: PCO, Buyer, Precurement 
Analyst/Contract Specialist, Negctiator/Ccst 
Analyst 

hegistics Technician (includes: Technician, Leqisxzics 
/Ecrovisioning Speciaiist) 

Quality Assurance Specialist 

Engineer 

IndustrialysProduction Specialist 


Other 


2. RankvGs Rating 


O-4/GS-12 or less (includes: O-2 or less/GS-10 
cor less, 0-3, O-4/GS-11,12) 


32 





O-—5765=13, 14 
0-6/GS-15 


6. Status 
Military (includes: Army, Navy, Air Force ) 


Civil Service 


7. Age 
Under 40 (includes: 20 - 30, 30 - 40) 
Over 40 (includes: 41 - 50, 51 - 60, Over 60) 


8.  Ssuperviser Status 
No Change 

9. if a Supervisor, The Number of Employees Supervised 
No Change 

10. Educaticn Level 


— me cole cee oye —eS ee a 


High School (includes: High School, Scme College) 
Collece (includes: College Graduate, Some Graduate 
Schcol) 


Graduate Degrees 


ii. Experience Level in Present Assignment 
5 years or less (includes: Less than 17 year, 1 to 3 
years, 3 to 5 years) 
Betc 4c years 


Over 10 years 


PZ = 


ict 
Tey 
the 
ire: 
{rH 
Q 
‘@) 
few 
ry 
lo 
is 
en) 
Is 
ict 
ny 
a0) 
fF 
Pay 
ict 
lo 
{Qu 
ies 
> 
lo 
ry 
te 
2 | 
To) 
Tan) 





years, 5 to 10 years) 


93 





3 3 


14. 


(oe 


1G 


eee 


10 tc 26 years 
Over 20 years 


Category Which Best Describes Current Product 


Specialty 
BlLeEectrenic 





Aircrafty/Missiles 

Shigpbcard 

Services 

Other (includes: Automotive, Mechanical, Zlectrical, 


Fuel, Ccnstruction Material) 


Contract Type Most Often Encountered 


=e ee eee 2 Pp Se 


Cost (includes: CPPE. CPilr, ~CPAr 4 
Fixed Price (includes: FPI, FP) 
Other 


10 or less (includes: Less than 5, 5 to 10) 
11. to: 20 
a tc 0 
Over 50 


Per Contract 


a ———e 


Average Dollar Value 

$10C,000 and less 

$1€0,000 to $1 million (includes $100,000 to $50,000, 
$500,000 to S17 milter) 

Sie co os, old bon 


Over $5 -mitiion 


94 





DYER ACT: 
SERVACT; 
HEBIITLE s 
RATING: 
sla fus; 
AGE: 
SUPVSTAT: 
NOSUPV: 


ELUCLEYV 
EAPERPA 
PeLenOCkxX ; 
ERCDSPEC: 


Tre EPRCC: 
CENT? YEE: 
NOCONT: 

AVDOLVAL: 


APPENDIX 7 


TABLES 2 o> We WO. f= <3 


Key To Table Abbreviations 


Type Of Activity 

Service Of Activity 

CUERENtdODen ele 

Rank/GS Rating 

SEatus “(N7latary OF Ciya iia a) 

Age 

Supervisor Status 

I= A Supervisor, The Number Of Employees 
Supervised 

Education Level 

Experience Level In Present Assignment 
Total Procurement Related Fxperience 
Category Which Best Describes Current 
Product-Specialty 

Type Of Procurement Most Often Encountered 
Contract Type Most Often Enccuntered 
Numgper Of Contracts ror The Year 


Average Dollar Value Per Contract 


JD 





Overall General Contract Administration 


Inde 
Var’ 


Pee ac ft 
SERVACT 
JCOLITLE 
RATING 
STATUS 
AGE 
SUPVSTAT 
NOSUPV 
ELUCLEV 
EXPERPA 
TCTPROEX 
FRODSPEC 
meme LE RCC 
COUT TYPE 
NOCCONT 
AVDOLVAL 


Chi - 
Square 
4.14865 


5201596 
17.99606 
4.04246 
1.02341 

- 14452 
4.725956 
7.92042 


-64507 . 


3.14804 
- 26002 
15.49196 
Sao eo) 
See AT ies 
- 98966 
Sree Os! Ae, 


TABLE 


¢- 


Signif 


»2459 
SOO 
-0030 
sI325 
eo ut? 
- 1/068 
=z 210 
0945 
~7243 
E2072 
-8781 
20056 
20572 
908% 
8038 
a gow 


96 


1 


Cramer's 
YZ Phu 


-08414 
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APPENDIX G 


TOTAL SURVEY FREQUENCIES 


Appendix G iS separately bound. 
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Appendix H is separately bound. 
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